02.12.2021 17:25:00,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:00,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:00,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:00,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,040 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,056 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239864ms for 240000ms of delay, sleeping for 146ms
02.12.2021 17:25:00,094 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:00,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:00,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,110 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:00,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,111 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 475
02.12.2021 17:25:00,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,138 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59890ms for 60000ms of delay, sleeping for 120ms
02.12.2021 17:25:00,141 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119953ms for 120000ms of delay, sleeping for 57ms
02.12.2021 17:25:00,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:00,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,147 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:00,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119260ms for 120000ms of delay, sleeping for 750ms
02.12.2021 17:25:00,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 375
02.12.2021 17:25:00,214 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239844ms for 240000ms of delay, sleeping for 166ms
02.12.2021 17:25:00,230 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239989ms delay out of 240000ms. Remaining 11ms. Executor queue at 0
02.12.2021 17:25:00,235 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239271ms for 240000ms of delay, sleeping for 739ms
02.12.2021 17:25:00,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:00,259 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59279ms for 60000ms of delay, sleeping for 731ms
02.12.2021 17:25:00,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:00,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:00,312 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 274
02.12.2021 17:25:00,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:00,383 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239381ms for 240000ms of delay, sleeping for 629ms
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:00,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:00,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 161
02.12.2021 17:25:00,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:00,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:00,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:00,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 61
02.12.2021 17:25:00,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,541 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,587 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,587 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,587 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=685) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null}
02.12.2021 17:25:00,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 24
02.12.2021 17:25:00,589 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=685): org.apache.kafka.common.requests.HeartbeatResponse@3c411aa
02.12.2021 17:25:00,589 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,589 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:00,589 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,589 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,590 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 85, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,590 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=686) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:00,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 21
02.12.2021 17:25:00,590 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,590 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,590 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=685) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null}
02.12.2021 17:25:00,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,591 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=685): org.apache.kafka.common.requests.HeartbeatResponse@40a11dc4
02.12.2021 17:25:00,592 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,592 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:00,593 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,593 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,593 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 85, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,593 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=686) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:00,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:00,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,611 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,611 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:00,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,648 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,649 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,687 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,690 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,743 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:00,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:00,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:00,883 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,884 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:00,884 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1055) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:00,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,896 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:00,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:00,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:00,964 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119143ms for 120000ms of delay, sleeping for 867ms
02.12.2021 17:25:00,984 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1055): org.apache.kafka.common.requests.HeartbeatResponse@4b575fe7
02.12.2021 17:25:00,984 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:00,993 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239829ms for 240000ms of delay, sleeping for 181ms
02.12.2021 17:25:01,008 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59068ms for 60000ms of delay, sleeping for 942ms
02.12.2021 17:25:01,021 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239965ms for 240000ms of delay, sleeping for 45ms
02.12.2021 17:25:01,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:01,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:01,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,043 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,043 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,068 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 236114ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:01,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,113 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:01,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,114 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:01,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:01,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,152 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,153 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,179 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239036ms for 240000ms of delay, sleeping for 974ms
02.12.2021 17:25:01,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:01,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:01,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:01,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:01,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:01,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,404 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:01,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:01,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:01,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,543 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,614 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,615 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:01,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,654 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:01,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:01,796 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:01,796 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:01,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:01,796 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1116) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null}
02.12.2021 17:25:01,845 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:01,845 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119572ms for 120000ms of delay, sleeping for 438ms
02.12.2021 17:25:01,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,918 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,926 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1116): org.apache.kafka.common.requests.HeartbeatResponse@343270c9
02.12.2021 17:25:01,936 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:01,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:01,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:01,959 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59117ms for 60000ms of delay, sleeping for 893ms
02.12.2021 17:25:02,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 71
02.12.2021 17:25:02,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:02,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,051 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,068 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 237114ms delay out of 240000ms. Remaining 2886ms. Executor queue at 0
02.12.2021 17:25:02,083 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 237126ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:02,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,115 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,116 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 467
02.12.2021 17:25:02,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:02,157 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239527ms for 240000ms of delay, sleeping for 483ms
02.12.2021 17:25:02,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,157 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 366
02.12.2021 17:25:02,247 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,247 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 54 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:02,247 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1392) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=54,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null}
02.12.2021 17:25:02,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:02,300 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119970ms for 120000ms of delay, sleeping for 40ms
02.12.2021 17:25:02,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 266
02.12.2021 17:25:02,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 55 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:02,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 170366ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:02,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:02,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 56 iterations.
02.12.2021 17:25:02,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 56 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:02,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 170366ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:02,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:02,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:02,342 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:02,342 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:02,342 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:02,342 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 85, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 4])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:02,343 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1117) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:02,343 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999160, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:02,343 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999170, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:02,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:02,343 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:02,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,343 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:02,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 56 iterations.
02.12.2021 17:25:02,347 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1392): org.apache.kafka.common.requests.HeartbeatResponse@344845d6
02.12.2021 17:25:02,347 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:02,354 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119272ms for 120000ms of delay, sleeping for 738ms
02.12.2021 17:25:02,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:02,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 165
02.12.2021 17:25:02,442 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:02,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 532 ms and fetched 0 records
02.12.2021 17:25:02,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,452 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:02,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 65
02.12.2021 17:25:02,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:02,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,555 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 24
02.12.2021 17:25:02,580 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,580 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,580 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=695) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:02,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 476
02.12.2021 17:25:02,580 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=695): org.apache.kafka.common.requests.HeartbeatResponse@5c6272dd
02.12.2021 17:25:02,580 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:02,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 475
02.12.2021 17:25:02,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 474
02.12.2021 17:25:02,584 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,584 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,584 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=671) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:02,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,585 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=671): org.apache.kafka.common.requests.HeartbeatResponse@1ee9de64
02.12.2021 17:25:02,587 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:02,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 29
02.12.2021 17:25:02,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 29
02.12.2021 17:25:02,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:02,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,620 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,621 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,621 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:02,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,622 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,643 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239461ms for 240000ms of delay, sleeping for 549ms
02.12.2021 17:25:02,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 521 ms and fetched 0 records
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 374
02.12.2021 17:25:02,723 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:02,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 274
02.12.2021 17:25:02,823 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:02,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:02,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:02,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:02,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:02,874 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142854, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:02,874 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142864, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:02,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:02,874 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:02,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,874 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:02,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:02,875 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59387ms for 60000ms of delay, sleeping for 623ms
02.12.2021 17:25:02,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 173
02.12.2021 17:25:02,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:02,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:02,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,955 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,956 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 67
02.12.2021 17:25:03,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:03,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,057 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,083 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 238126ms delay out of 240000ms. Remaining 1874ms. Executor queue at 1
02.12.2021 17:25:03,084 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238089ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:03,096 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118994ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:03,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:03,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,125 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,181 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,194 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239907ms for 240000ms of delay, sleeping for 103ms
02.12.2021 17:25:03,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:03,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 64 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 184142ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 184142ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:03,298 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:03,298 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:03,298 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 36, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:03,299 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1393) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:03,299 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962714, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:03,299 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962724, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:03,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:03,299 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:03,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,299 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:03,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:03,300 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239502ms for 240000ms of delay, sleeping for 508ms
02.12.2021 17:25:03,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:03,356 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:03,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:03,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:03,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,456 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,463 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:03,500 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59696ms for 60000ms of delay, sleeping for 314ms
02.12.2021 17:25:03,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:03,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,558 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,623 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,626 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,626 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,683 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:03,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:03,820 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59675ms for 60000ms of delay, sleeping for 335ms
02.12.2021 17:25:03,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:03,827 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239833ms for 240000ms of delay, sleeping for 177ms
02.12.2021 17:25:03,859 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:03,898 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:03,917 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:03,917 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1056) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:03,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:03,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 73
02.12.2021 17:25:04,014 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239680ms for 240000ms of delay, sleeping for 330ms
02.12.2021 17:25:04,018 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1056): org.apache.kafka.common.requests.HeartbeatResponse@4b753649
02.12.2021 17:25:04,018 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:04,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:04,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:04,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,068 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,084 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239089ms delay out of 240000ms. Remaining 911ms. Executor queue at 2
02.12.2021 17:25:04,097 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119994ms delay out of 120000ms. Remaining 6ms. Executor queue at 3
02.12.2021 17:25:04,101 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119038ms for 120000ms of delay, sleeping for 972ms
02.12.2021 17:25:04,102 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239048ms for 240000ms of delay, sleeping for 962ms
02.12.2021 17:25:04,114 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=681): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', members=[])
02.12.2021 17:25:04,114 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', members=[])
02.12.2021 17:25:04,114 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:04,114 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}
02.12.2021 17:25:04,115 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:04,115 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=682) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:04,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 68
02.12.2021 17:25:04,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,127 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:04,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,128 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,129 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,157 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59622ms for 60000ms of delay, sleeping for 388ms
02.12.2021 17:25:04,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,184 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,191 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=682): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,196 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,196 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=55, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}
02.12.2021 17:25:04,196 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 55 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a
02.12.2021 17:25:04,197 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:04,197 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:04,197 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:04,198 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:04,198 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:04,199 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from RUNNING to REBALANCING
02.12.2021 17:25:04,199 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:04,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 488
02.12.2021 17:25:04,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:04,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:04,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 383
02.12.2021 17:25:04,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:04,368 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239974ms for 240000ms of delay, sleeping for 36ms
02.12.2021 17:25:04,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:04,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 282
02.12.2021 17:25:04,406 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239472ms for 240000ms of delay, sleeping for 538ms
02.12.2021 17:25:04,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:04,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:04,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,475 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 182
02.12.2021 17:25:04,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:04,547 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59542ms for 60000ms of delay, sleeping for 468ms
02.12.2021 17:25:04,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,569 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 81
02.12.2021 17:25:04,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,628 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,629 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:04,686 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:04,686 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from REBALANCING to RUNNING
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:04,771 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:04,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:04,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:04,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:04,888 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:04,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:04,949 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239574ms for 240000ms of delay, sleeping for 436ms
02.12.2021 17:25:04,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:04,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,976 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:05,017 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59170ms for 60000ms of delay, sleeping for 840ms
02.12.2021 17:25:05,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:05,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 10 records with 45 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 166851ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:05,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:05,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 46 iterations.
02.12.2021 17:25:05,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 46 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 166851ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:05,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:05,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,065 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=729): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', members=[])
02.12.2021 17:25:05,066 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', members=[])
02.12.2021 17:25:05,066 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:05,066 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}
02.12.2021 17:25:05,066 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:05,066 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=730) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null,assignments=[]}
02.12.2021 17:25:05,066 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=953577, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:05,068 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=953587, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:05,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:05,069 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-8, new queue size is 10
02.12.2021 17:25:05,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,070 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,069 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 46 iterations.
02.12.2021 17:25:05,072 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239015ms for 240000ms of delay, sleeping for 995ms
02.12.2021 17:25:05,075 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119763ms for 120000ms of delay, sleeping for 247ms
02.12.2021 17:25:05,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:05,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,129 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:05,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,131 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 452
02.12.2021 17:25:05,168 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=730): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:05,168 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=55, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}
02.12.2021 17:25:05,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:05,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,188 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 352
02.12.2021 17:25:05,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:05,287 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=686): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:05,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:05,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:05,287 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:05,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:05,287 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=687) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,assignments=[]}
02.12.2021 17:25:05,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:05,288 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=686): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:05,288 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:05,289 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:05,289 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:05,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:05,289 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:05,293 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=687) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,assignments=[]}
02.12.2021 17:25:05,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 336
02.12.2021 17:25:05,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 252
02.12.2021 17:25:05,352 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119390ms for 120000ms of delay, sleeping for 620ms
02.12.2021 17:25:05,335 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=687): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,354 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,354 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=186, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:05,354 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 186 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:05,354 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:05,354 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:05,354 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:05,355 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:05,355 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:05,355 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from RUNNING to REBALANCING
02.12.2021 17:25:05,355 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:05,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 122
02.12.2021 17:25:05,335 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=687): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,355 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,355 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=186, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:05,355 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 186 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:05,355 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:05,355 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:05,355 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:05,355 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:05,355 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:05,355 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:05,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 274
02.12.2021 17:25:05,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:05,389 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239280ms for 240000ms of delay, sleeping for 730ms
02.12.2021 17:25:05,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:05,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 151
02.12.2021 17:25:05,455 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 21
02.12.2021 17:25:05,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 173
02.12.2021 17:25:05,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:05,477 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:05,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 51
02.12.2021 17:25:05,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 73
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 9
02.12.2021 17:25:05,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:05,581 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,581 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,581 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=696) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:05,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 491
02.12.2021 17:25:05,581 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=696): org.apache.kafka.common.requests.HeartbeatResponse@6295ce83
02.12.2021 17:25:05,581 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:05,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 490
02.12.2021 17:25:05,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 490
02.12.2021 17:25:05,584 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,585 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,585 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=672) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:05,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,585 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=672): org.apache.kafka.common.requests.HeartbeatResponse@a17762e
02.12.2021 17:25:05,585 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:05,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 47
02.12.2021 17:25:05,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 47
02.12.2021 17:25:05,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:05,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:05,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:05,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,633 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,633 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:05,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,633 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:05,634 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:05,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,634 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:05,635 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:05,635 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:05,635 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:05,635 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:05,635 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from REBALANCING to RUNNING
02.12.2021 17:25:05,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:05,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,635 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:05,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 389
02.12.2021 17:25:05,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,689 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,689 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:05,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:05,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:05,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 289
02.12.2021 17:25:05,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:05,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:05,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:05,860 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59856ms for 60000ms of delay, sleeping for 154ms
02.12.2021 17:25:05,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:05,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:05,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:05,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:05,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 187
02.12.2021 17:25:05,981 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119938ms for 120000ms of delay, sleeping for 72ms
02.12.2021 17:25:05,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:05,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 514 ms and fetched 0 records
02.12.2021 17:25:05,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,997 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 74
02.12.2021 17:25:06,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:06,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:06,019 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142864, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:06,019 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142874, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:06,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:06,019 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:06,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,019 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:06,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:06,019 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59900ms for 60000ms of delay, sleeping for 110ms
02.12.2021 17:25:06,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:06,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 87
02.12.2021 17:25:06,058 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119559ms for 120000ms of delay, sleeping for 451ms
02.12.2021 17:25:06,068 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239182ms for 240000ms of delay, sleeping for 828ms
02.12.2021 17:25:06,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,072 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:06,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,122 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239712ms for 240000ms of delay, sleeping for 298ms
02.12.2021 17:25:06,131 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59991ms for 60000ms of delay, sleeping for 19ms
02.12.2021 17:25:06,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,135 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:06,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,142 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,158 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59688ms for 60000ms of delay, sleeping for 322ms
02.12.2021 17:25:06,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,189 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:06,201 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:06,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:06,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:06,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:06,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:06,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:06,391 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:06,399 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:06,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:06,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 187265ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:06,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:06,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:06,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 187266ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:06,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:06,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:06,422 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1393): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', members=[])
02.12.2021 17:25:06,422 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', members=[])
02.12.2021 17:25:06,422 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:06,423 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}
02.12.2021 17:25:06,423 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:06,423 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962724, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:06,423 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962734, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:06,423 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1394) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:06,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:06,423 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1394): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:06,424 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:06,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,424 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:06,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:06,424 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=55, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}
02.12.2021 17:25:06,425 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239282ms for 240000ms of delay, sleeping for 728ms
02.12.2021 17:25:06,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:06,447 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:06,481 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59513ms for 60000ms of delay, sleeping for 497ms
02.12.2021 17:25:06,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:06,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,497 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:06,513 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119435ms for 120000ms of delay, sleeping for 575ms
02.12.2021 17:25:06,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:06,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:06,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:06,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:06,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,601 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,636 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,643 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,643 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,690 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,690 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 424
02.12.2021 17:25:06,698 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:06,701 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:06,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 324
02.12.2021 17:25:06,800 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:06,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:06,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:06,842 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:06,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 223
02.12.2021 17:25:06,901 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239737ms for 240000ms of delay, sleeping for 273ms
02.12.2021 17:25:06,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:06,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:06,926 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:06,926 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:06,926 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1057) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:06,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:06,946 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:06,980 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58935ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:06,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 123
02.12.2021 17:25:06,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,999 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30313ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:07,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:07,031 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1057): org.apache.kafka.common.requests.HeartbeatResponse@4bdb705
02.12.2021 17:25:07,055 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:07,046 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:07,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:07,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 22
02.12.2021 17:25:07,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 56 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 175117ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:07,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:07,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 57 iterations.
02.12.2021 17:25:07,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 57 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 175117ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:07,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:07,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:07,094 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1117): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:07,094 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:07,094 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:07,094 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:07,094 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:07,094 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999170, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:07,094 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999180, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:07,094 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1118) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,assignments=[]}
02.12.2021 17:25:07,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:07,094 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:07,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,094 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:07,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 57 iterations.
02.12.2021 17:25:07,095 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1118): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:07,096 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=186, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:07,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:07,104 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119957ms for 120000ms of delay, sleeping for 53ms
02.12.2021 17:25:07,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,105 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,115 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:07,118 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:07,118 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=683) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null}
02.12.2021 17:25:07,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:07,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 72
02.12.2021 17:25:07,139 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=683): org.apache.kafka.common.requests.HeartbeatResponse@714d869e
02.12.2021 17:25:07,139 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:07,139 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 55 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a
02.12.2021 17:25:07,139 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:07,139 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:07,139 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 38, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:07,139 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=684) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:07,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 50
02.12.2021 17:25:07,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239989ms for 240000ms of delay, sleeping for 21ms
02.12.2021 17:25:07,158 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119631ms for 120000ms of delay, sleeping for 379ms
02.12.2021 17:25:07,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 524 ms and fetched 0 records
02.12.2021 17:25:07,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,161 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 528 ms and fetched 0 records
02.12.2021 17:25:07,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,171 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30280ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:07,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,176 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239484ms for 240000ms of delay, sleeping for 526ms
02.12.2021 17:25:07,179 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 235272ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:07,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,190 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:07,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:07,218 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:07,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:07,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:07,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:07,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:07,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:07,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:07,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:07,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:07,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:07,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:07,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,501 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:07,539 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118374ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:07,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:07,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:07,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,673 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,673 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,692 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,692 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,697 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:07,704 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239816ms for 240000ms of delay, sleeping for 194ms
02.12.2021 17:25:07,704 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:07,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:07,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:07,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:07,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:07,863 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:07,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:07,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:07,908 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 236229ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:07,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:07,964 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:07,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 190
02.12.2021 17:25:07,983 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59938ms delay out of 60000ms. Remaining 62ms. Executor queue at 0
02.12.2021 17:25:07,985 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59164ms for 60000ms of delay, sleeping for 846ms
02.12.2021 17:25:08,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 272
02.12.2021 17:25:08,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:08,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:08,074 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,076 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:08,082 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=731) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null}
02.12.2021 17:25:08,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:08,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 172
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 464
02.12.2021 17:25:08,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:08,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,165 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 418
02.12.2021 17:25:08,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:08,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,178 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 111
02.12.2021 17:25:08,179 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 236272ms delay out of 240000ms. Remaining 3728ms. Executor queue at 0
02.12.2021 17:25:08,180 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 236263ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:08,182 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=731): org.apache.kafka.common.requests.HeartbeatResponse@7deca230
02.12.2021 17:25:08,182 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:08,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,197 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 71
02.12.2021 17:25:08,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 364
02.12.2021 17:25:08,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 317
02.12.2021 17:25:08,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 10
02.12.2021 17:25:08,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,287 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,288 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=688) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null}
02.12.2021 17:25:08,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 228
02.12.2021 17:25:08,288 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=688): org.apache.kafka.common.requests.HeartbeatResponse@17f8b6a
02.12.2021 17:25:08,288 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:08,288 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 186 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:08,288 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:08,288 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:08,288 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 86, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,288 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=689) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:08,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 226
02.12.2021 17:25:08,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,289 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,290 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,290 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=688) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null}
02.12.2021 17:25:08,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 389
02.12.2021 17:25:08,290 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=688): org.apache.kafka.common.requests.HeartbeatResponse@74e837f2
02.12.2021 17:25:08,290 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:08,290 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 186 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:08,290 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:08,290 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:08,290 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 86, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,290 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=689) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:08,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 387
02.12.2021 17:25:08,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 264
02.12.2021 17:25:08,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 217
02.12.2021 17:25:08,388 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,390 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 161
02.12.2021 17:25:08,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 114
02.12.2021 17:25:08,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,515 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 58
02.12.2021 17:25:08,539 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119374ms delay out of 120000ms. Remaining 626ms. Executor queue at 1
02.12.2021 17:25:08,540 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119113ms for 120000ms of delay, sleeping for 897ms
02.12.2021 17:25:08,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 13
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,584 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,584 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,584 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=697) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:08,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 33
02.12.2021 17:25:08,584 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=697): org.apache.kafka.common.requests.HeartbeatResponse@5ac8cc8
02.12.2021 17:25:08,584 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:08,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 33
02.12.2021 17:25:08,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 33
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,588 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,588 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=673) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:08,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 78
02.12.2021 17:25:08,589 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=673): org.apache.kafka.common.requests.HeartbeatResponse@40ce3299
02.12.2021 17:25:08,589 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:08,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:08,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:08,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,618 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,618 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:08,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:08,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,679 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,679 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,698 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,698 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:08,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:08,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:08,844 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59758ms for 60000ms of delay, sleeping for 252ms
02.12.2021 17:25:08,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:08,908 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 237230ms delay out of 240000ms. Remaining 2770ms. Executor queue at 2
02.12.2021 17:25:08,909 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 237226ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:08,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:08,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:09,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:09,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,023 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:09,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:09,106 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59954ms for 60000ms of delay, sleeping for 56ms
02.12.2021 17:25:09,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,119 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:09,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:09,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:09,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:09,164 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142874, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:09,164 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142884, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:09,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:09,165 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:09,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,165 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:09,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:09,165 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59059ms for 60000ms of delay, sleeping for 951ms
02.12.2021 17:25:09,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,168 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,180 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,180 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 237263ms delay out of 240000ms. Remaining 2737ms. Executor queue at 2
02.12.2021 17:25:09,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,181 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 237229ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:09,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,199 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:09,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:09,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:09,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:09,440 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119588ms for 120000ms of delay, sleeping for 422ms
02.12.2021 17:25:09,445 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:09,446 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:09,446 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1395) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null}
02.12.2021 17:25:09,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:09,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:09,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,523 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,546 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1395): org.apache.kafka.common.requests.HeartbeatResponse@caa5a7b
02.12.2021 17:25:09,546 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:09,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:09,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,619 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:09,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,672 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:09,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,684 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,700 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,700 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:09,865 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119902ms for 120000ms of delay, sleeping for 108ms
02.12.2021 17:25:09,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:09,911 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 238228ms delay out of 240000ms. Remaining 1772ms. Executor queue at 3
02.12.2021 17:25:09,912 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238224ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:09,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:09,965 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:09,965 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:09,971 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1058) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:09,977 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119694ms for 120000ms of delay, sleeping for 316ms
02.12.2021 17:25:09,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:10,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:10,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,036 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:10,072 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1058): org.apache.kafka.common.requests.HeartbeatResponse@2303d395
02.12.2021 17:25:10,072 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:10,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:10,107 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:10,108 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:10,108 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1119) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null}
02.12.2021 17:25:10,119 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59879ms for 60000ms of delay, sleeping for 131ms
02.12.2021 17:25:10,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,121 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:10,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,176 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,181 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 238229ms delay out of 240000ms. Remaining 1771ms. Executor queue at 4
02.12.2021 17:25:10,183 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238061ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:10,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,185 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:10,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,208 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,211 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1119): org.apache.kafka.common.requests.HeartbeatResponse@3fac1711
02.12.2021 17:25:10,212 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:10,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,252 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59966ms for 60000ms of delay, sleeping for 44ms
02.12.2021 17:25:10,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,294 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119229ms for 120000ms of delay, sleeping for 781ms
02.12.2021 17:25:10,297 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59446ms for 60000ms of delay, sleeping for 564ms
02.12.2021 17:25:10,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:10,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:10,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:10,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:10,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:10,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,537 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:10,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,623 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,676 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,676 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,688 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,709 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,726 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:10,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:10,866 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59935ms for 60000ms of delay, sleeping for 75ms
02.12.2021 17:25:10,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:10,924 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239236ms delay out of 240000ms. Remaining 764ms. Executor queue at 5
02.12.2021 17:25:10,925 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239228ms for 240000ms of delay, sleeping for 782ms
02.12.2021 17:25:10,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:10,945 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59861ms for 60000ms of delay, sleeping for 149ms
02.12.2021 17:25:10,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:11,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:11,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,038 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,038 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 57 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 179100ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 58 iterations.
02.12.2021 17:25:11,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 58 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 179100ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:11,077 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:11,077 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:11,077 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:11,077 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 86, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 4])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:11,077 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1120) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:11,077 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999180, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:11,078 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999190, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:11,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:11,078 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:11,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,078 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:11,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 58 iterations.
02.12.2021 17:25:11,078 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:11,078 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119990ms for 120000ms of delay, sleeping for 20ms
02.12.2021 17:25:11,089 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,089 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:11,089 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=732) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null}
02.12.2021 17:25:11,096 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59875ms for 60000ms of delay, sleeping for 135ms
02.12.2021 17:25:11,100 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118998ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:11,113 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:11,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,124 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 459
02.12.2021 17:25:11,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,177 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 410
02.12.2021 17:25:11,183 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239061ms delay out of 240000ms. Remaining 939ms. Executor queue at 6
02.12.2021 17:25:11,184 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239030ms for 240000ms of delay, sleeping for 980ms
02.12.2021 17:25:11,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,189 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,189 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=732): org.apache.kafka.common.requests.HeartbeatResponse@7d47bfbd
02.12.2021 17:25:11,190 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:11,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,210 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,210 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 358
02.12.2021 17:25:11,238 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59498ms for 60000ms of delay, sleeping for 512ms
02.12.2021 17:25:11,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 310
02.12.2021 17:25:11,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 258
02.12.2021 17:25:11,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 210
02.12.2021 17:25:11,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 157
02.12.2021 17:25:11,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 109
02.12.2021 17:25:11,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 57
02.12.2021 17:25:11,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,539 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 9
02.12.2021 17:25:11,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,583 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,584 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,584 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=698) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:11,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 40
02.12.2021 17:25:11,584 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=698): org.apache.kafka.common.requests.HeartbeatResponse@197da8e1
02.12.2021 17:25:11,584 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:11,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 40
02.12.2021 17:25:11,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 40
02.12.2021 17:25:11,587 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,588 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,588 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=674) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:11,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:11,589 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=674): org.apache.kafka.common.requests.HeartbeatResponse@4e01df4b
02.12.2021 17:25:11,590 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:11,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:11,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:11,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,625 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,626 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,677 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:11,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,696 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:11,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,715 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 10 records with 46 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 173526ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 47 iterations.
02.12.2021 17:25:11,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 47 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 173526ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,740 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:11,744 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:11,744 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:11,745 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 8])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:11,745 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=733) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:11,745 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=953587, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:11,745 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=953597, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:11,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:11,747 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-8, new queue size is 10
02.12.2021 17:25:11,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,747 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 47 iterations.
02.12.2021 17:25:11,750 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239786ms for 240000ms of delay, sleeping for 224ms
02.12.2021 17:25:11,752 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59821ms for 60000ms of delay, sleeping for 189ms
02.12.2021 17:25:11,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 394
02.12.2021 17:25:11,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:11,802 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:11,859 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 273
02.12.2021 17:25:11,889 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 288
02.12.2021 17:25:11,951 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59109ms for 60000ms of delay, sleeping for 901ms
02.12.2021 17:25:11,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 155
02.12.2021 17:25:11,980 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239709ms for 240000ms of delay, sleeping for 301ms
02.12.2021 17:25:11,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:12,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,046 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,071 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 55
02.12.2021 17:25:12,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:12,101 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119999ms delay out of 120000ms. Remaining 1ms. Executor queue at 1
02.12.2021 17:25:12,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:12,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,129 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,129 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,132 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119954ms for 120000ms of delay, sleeping for 56ms
02.12.2021 17:25:12,166 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239849ms for 240000ms of delay, sleeping for 161ms
02.12.2021 17:25:12,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,180 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,180 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,193 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119288ms for 120000ms of delay, sleeping for 722ms
02.12.2021 17:25:12,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:12,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,197 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:12,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:12,283 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239154ms for 240000ms of delay, sleeping for 856ms
02.12.2021 17:25:12,330 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239302ms for 240000ms of delay, sleeping for 708ms
02.12.2021 17:25:12,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:12,383 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:12,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:12,451 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:12,452 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:12,452 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1396) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null}
02.12.2021 17:25:12,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:12,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:12,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:12,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,546 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,547 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,552 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1396): org.apache.kafka.common.requests.HeartbeatResponse@59032da6
02.12.2021 17:25:12,553 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:12,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:12,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,630 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,684 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,698 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,720 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:12,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:12,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:12,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:12,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:12,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:12,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:12,866 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142884, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:12,866 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142894, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:12,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:12,867 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:12,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,867 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:12,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:12,876 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59771ms for 60000ms of delay, sleeping for 239ms
02.12.2021 17:25:12,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:12,917 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119719ms for 120000ms of delay, sleeping for 291ms
02.12.2021 17:25:12,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:12,984 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:12,984 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:12,985 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1059) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:12,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:13,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:13,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 193883ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:13,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 193883ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:13,039 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:13,039 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:13,039 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:13,040 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:13,041 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1397) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:13,041 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 4 fetched records at offset FetchPosition{offset=962734, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:13,041 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962738, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:13,041 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:1199] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Added READ_UNCOMMITTED fetch request for partition redacted.Cloud.Message.Callback.Retry3-0 at position FetchPosition{offset=962738, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)], epoch=absent}} to node kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)
02.12.2021 17:25:13,041 DEBUG [org.apache.kafka.clients.FetchSessionHandler:259] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Built incremental fetch (sessionId=300207522, epoch=677) for node 4. Added (), altered (redacted.Cloud.Message.Callback.Retry3-0), removed () out of (OSS.STAGING.Cloud.Message.Callback.Retry3-0)
02.12.2021 17:25:13,041 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:266] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(redacted.Cloud.Message.Callback.Retry3-0), toForget=(), implied=()) to broker kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)
02.12.2021 17:25:13,041 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending FETCH request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1398) and timeout 30000 to node 4: {replica_id=-1,max_wait_ms=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=300207522,session_epoch=677,topics=[{topic=redacted.Cloud.Message.Callback.Retry3,partitions=[{partition=0,current_leader_epoch=-1,fetch_offset=962738,log_start_offset=-1,partition_max_bytes=1048576}]}],forgotten_topics_data=[],rack_id=}
02.12.2021 17:25:13,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 4 records
02.12.2021 17:25:13,042 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 4
02.12.2021 17:25:13,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,042 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:13,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:13,043 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239337ms for 240000ms of delay, sleeping for 673ms
02.12.2021 17:25:13,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,047 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,054 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:13,085 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1059): org.apache.kafka.common.requests.HeartbeatResponse@525a1875
02.12.2021 17:25:13,085 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:13,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:13,117 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59853ms for 60000ms of delay, sleeping for 157ms
02.12.2021 17:25:13,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,130 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,142 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239926ms for 240000ms of delay, sleeping for 84ms
02.12.2021 17:25:13,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,185 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,200 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,210 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119065ms for 120000ms of delay, sleeping for 945ms
02.12.2021 17:25:13,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,222 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 10 records with 47 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 175013ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 48 iterations.
02.12.2021 17:25:13,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 48 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 175013ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,228 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=953597, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:13,228 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=953607, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:13,228 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-8, new queue size is 10
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 48 iterations.
02.12.2021 17:25:13,230 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239178ms for 240000ms of delay, sleeping for 832ms
02.12.2021 17:25:13,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:13,276 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59402ms for 60000ms of delay, sleeping for 608ms
02.12.2021 17:25:13,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:13,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:13,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:13,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:13,488 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:13,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:13,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,548 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:13,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,630 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,688 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,689 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,701 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,718 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239827ms for 240000ms of delay, sleeping for 183ms
02.12.2021 17:25:13,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,723 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,724 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,724 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:13,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:13,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:13,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:13,892 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59731ms for 60000ms of delay, sleeping for 279ms
02.12.2021 17:25:13,910 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238928ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:13,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:13,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:14,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:14,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,059 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,060 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,065 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239883ms for 240000ms of delay, sleeping for 127ms
02.12.2021 17:25:14,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:14,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:14,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,138 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,139 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 444
02.12.2021 17:25:14,156 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119980ms for 120000ms of delay, sleeping for 30ms
02.12.2021 17:25:14,158 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=689): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:14,158 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=689): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:14,158 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:14,158 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:14,158 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:14,159 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:14,159 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:14,159 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:14,159 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,159 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,159 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=690) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,159 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=690) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 401
02.12.2021 17:25:14,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 43
02.12.2021 17:25:14,174 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59221ms for 60000ms of delay, sleeping for 789ms
02.12.2021 17:25:14,188 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119065ms for 120000ms of delay, sleeping for 945ms
02.12.2021 17:25:14,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,190 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:14,193 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239948ms for 240000ms of delay, sleeping for 62ms
02.12.2021 17:25:14,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:14,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,208 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,225 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 343
02.12.2021 17:25:14,257 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238468ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:14,290 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=690): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,290 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=690): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,290 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,290 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=187, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:14,290 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 187 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:14,290 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:14,290 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,290 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:14,290 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:14,290 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,290 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from RUNNING to REBALANCING
02.12.2021 17:25:14,290 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:14,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 418
02.12.2021 17:25:14,290 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,291 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=187, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:14,291 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 187 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:14,291 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:14,291 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,291 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,291 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:14,291 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,291 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:14,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 270
02.12.2021 17:25:14,336 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=684): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', members=[])
02.12.2021 17:25:14,348 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', members=[])
02.12.2021 17:25:14,351 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:14,352 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}
02.12.2021 17:25:14,352 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,352 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=685) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 373
02.12.2021 17:25:14,341 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 242
02.12.2021 17:25:14,379 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=685): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,379 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,379 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=56, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}
02.12.2021 17:25:14,379 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 56 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a
02.12.2021 17:25:14,379 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:14,380 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,380 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,380 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:14,380 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,380 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from RUNNING to REBALANCING
02.12.2021 17:25:14,380 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:14,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 346
02.12.2021 17:25:14,391 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:14,391 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 317
02.12.2021 17:25:14,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 168
02.12.2021 17:25:14,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 126
02.12.2021 17:25:14,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 245
02.12.2021 17:25:14,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:14,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 217
02.12.2021 17:25:14,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 68
02.12.2021 17:25:14,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 25
02.12.2021 17:25:14,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,562 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 144
02.12.2021 17:25:14,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,583 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:14,583 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:14,584 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=699) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:14,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 56
02.12.2021 17:25:14,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 55
02.12.2021 17:25:14,585 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=699): org.apache.kafka.common.requests.HeartbeatResponse@5646d589
02.12.2021 17:25:14,585 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:14,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 54
02.12.2021 17:25:14,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 54
02.12.2021 17:25:14,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,587 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:14,588 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:14,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,588 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=675) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:14,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 102
02.12.2021 17:25:14,588 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=675): org.apache.kafka.common.requests.HeartbeatResponse@1e4b2211
02.12.2021 17:25:14,588 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:14,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 102
02.12.2021 17:25:14,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 102
02.12.2021 17:25:14,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 117
02.12.2021 17:25:14,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,639 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:14,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 44
02.12.2021 17:25:14,689 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 1
02.12.2021 17:25:14,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,690 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,701 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 8
02.12.2021 17:25:14,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,710 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,710 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from REBALANCING to RUNNING
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,710 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,726 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,726 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from REBALANCING to RUNNING
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:14,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:14,791 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:14,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:14,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:14,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:14,863 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:14,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:14,912 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239930ms delay out of 240000ms. Remaining 70ms. Executor queue at 0
02.12.2021 17:25:14,913 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239239ms for 240000ms of delay, sleeping for 771ms
02.12.2021 17:25:14,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:14,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 288
02.12.2021 17:25:14,942 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:14,964 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:14,973 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59858ms for 60000ms of delay, sleeping for 152ms
02.12.2021 17:25:14,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:15,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:15,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 187
02.12.2021 17:25:15,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:15,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,063 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:15,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:15,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:15,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:15,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:15,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:15,133 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142894, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:15,133 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142904, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:15,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:15,133 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:15,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,133 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:15,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:15,133 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59353ms for 60000ms of delay, sleeping for 657ms
02.12.2021 17:25:15,134 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119837ms for 120000ms of delay, sleeping for 173ms
02.12.2021 17:25:15,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 87
02.12.2021 17:25:15,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,140 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,192 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:15,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,214 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,228 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,258 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239469ms delay out of 240000ms. Remaining 531ms. Executor queue at 0
02.12.2021 17:25:15,259 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239053ms for 240000ms of delay, sleeping for 957ms
02.12.2021 17:25:15,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:15,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 58 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:15,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 183333ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:15,319 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:15,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:15,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 59 iterations.
02.12.2021 17:25:15,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 59 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:15,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 183348ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:15,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:15,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:15,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:15,331 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1120): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:15,352 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:15,352 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:15,352 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:15,352 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:15,352 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1121) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,assignments=[]}
02.12.2021 17:25:15,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:15,352 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999190, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:15,354 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999200, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:15,354 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1121): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:15,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 31 ms and fetched 10 records
02.12.2021 17:25:15,356 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:15,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,356 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:15,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 59 iterations.
02.12.2021 17:25:15,358 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119376ms for 120000ms of delay, sleeping for 634ms
02.12.2021 17:25:15,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:15,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:15,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 293
02.12.2021 17:25:15,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 276
02.12.2021 17:25:15,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:15,454 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=187, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:15,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:15,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:15,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:15,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 176
02.12.2021 17:25:15,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:15,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,564 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:15,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 92
02.12.2021 17:25:15,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,641 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 76
02.12.2021 17:25:15,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 4 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:15,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 196529ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:15,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:15,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:15,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:15,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 196529ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:15,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:15,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:15,692 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,692 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,692 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,692 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,692 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,692 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,692 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30209ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:15,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,690 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1397): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', members=[])
02.12.2021 17:25:15,693 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received FETCH response from node 4 for request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1398): org.apache.kafka.common.requests.FetchResponse@1f50e4b3
02.12.2021 17:25:15,694 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', members=[])
02.12.2021 17:25:15,696 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:15,696 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}
02.12.2021 17:25:15,696 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:15,696 DEBUG [org.apache.kafka.clients.FetchSessionHandler:463] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Node 4 sent an incremental fetch response with throttleTimeMs = 0 for session 300207522 with response=(redacted.Cloud.Message.Callback.Retry3-0)
02.12.2021 17:25:15,696 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:315] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Fetch READ_UNCOMMITTED at offset 962738 for partition redacted.Cloud.Message.Callback.Retry3-0 returned fetch data (error=NONE, highWaterMark=962873, lastStableOffset = 962873, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, divergingEpoch =Optional.empty, recordsSizeInBytes=61005)
02.12.2021 17:25:15,696 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1399) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:15,699 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1251] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Preparing to read 61005 bytes of data for partition redacted.Cloud.Message.Callback.Retry3-0 with offset FetchPosition{offset=962738, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)], epoch=absent}}
02.12.2021 17:25:15,700 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1275] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating high watermark for partition redacted.Cloud.Message.Callback.Retry3-0 to 962873
02.12.2021 17:25:15,700 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1280] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating log start offset for partition redacted.Cloud.Message.Callback.Retry3-0 to 0
02.12.2021 17:25:15,700 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1285] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating last stable offset for partition redacted.Cloud.Message.Callback.Retry3-0 to 962873
02.12.2021 17:25:15,701 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962738, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:15,702 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962748, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:15,702 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1399): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:15,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 13 ms and fetched 10 records
02.12.2021 17:25:15,703 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:15,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,703 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:15,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:15,704 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239547ms for 240000ms of delay, sleeping for 463ms
02.12.2021 17:25:15,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,718 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,729 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,792 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59704ms for 60000ms of delay, sleeping for 306ms
02.12.2021 17:25:15,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,799 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=56, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}
02.12.2021 17:25:15,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:15,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:15,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:15,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 293
02.12.2021 17:25:15,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:15,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:15,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:16,001 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119799ms for 120000ms of delay, sleeping for 211ms
02.12.2021 17:25:15,992 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:16,002 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:15,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:16,003 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1060) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:16,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:16,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:16,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:16,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:16,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,089 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:16,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,108 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1060): org.apache.kafka.common.requests.HeartbeatResponse@307fbb09
02.12.2021 17:25:16,100 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59931ms for 60000ms of delay, sleeping for 79ms
02.12.2021 17:25:16,108 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:16,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:16,139 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 79
02.12.2021 17:25:16,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,146 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30244ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:16,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,170 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239184ms for 240000ms of delay, sleeping for 826ms
02.12.2021 17:25:16,190 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59183ms for 60000ms of delay, sleeping for 827ms
02.12.2021 17:25:16,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,193 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 388
02.12.2021 17:25:16,218 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119098ms for 120000ms of delay, sleeping for 912ms
02.12.2021 17:25:16,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,230 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:16,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,241 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,240 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239527ms for 240000ms of delay, sleeping for 483ms
02.12.2021 17:25:16,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:16,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:16,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 288
02.12.2021 17:25:16,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:16,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:16,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:16,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:16,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 187
02.12.2021 17:25:16,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:16,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 280
02.12.2021 17:25:16,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 291
02.12.2021 17:25:16,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:16,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 87
02.12.2021 17:25:16,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 180
02.12.2021 17:25:16,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:16,551 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:16,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:16,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,593 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:16,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,648 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 79
02.12.2021 17:25:16,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:16,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:16,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,695 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,731 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239521ms for 240000ms of delay, sleeping for 489ms
02.12.2021 17:25:16,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,731 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:16,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,744 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 415
02.12.2021 17:25:16,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 394
02.12.2021 17:25:16,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:16,796 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:16,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:16,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 315
02.12.2021 17:25:16,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:16,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:16,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:16,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:16,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 214
02.12.2021 17:25:16,964 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:16,997 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239764ms for 240000ms of delay, sleeping for 246ms
02.12.2021 17:25:16,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:17,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 92
02.12.2021 17:25:17,019 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58963ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:17,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:17,046 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 113
02.12.2021 17:25:17,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:17,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,094 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 64
02.12.2021 17:25:17,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:17,133 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119016ms for 120000ms of delay, sleeping for 994ms
02.12.2021 17:25:17,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:17,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 12
02.12.2021 17:25:17,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,148 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 435
02.12.2021 17:25:17,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:17,159 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,159 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,159 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=691) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null}
02.12.2021 17:25:17,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 85
02.12.2021 17:25:17,160 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=691): org.apache.kafka.common.requests.HeartbeatResponse@54aedb31
02.12.2021 17:25:17,160 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,160 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,160 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,160 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=691) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null}
02.12.2021 17:25:17,160 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 187 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:17,160 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:17,160 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:17,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 436
02.12.2021 17:25:17,160 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 87, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,160 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=691): org.apache.kafka.common.requests.HeartbeatResponse@1600a23b
02.12.2021 17:25:17,160 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=692) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,160 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,160 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 187 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:17,160 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:17,161 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:17,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 84
02.12.2021 17:25:17,161 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 87, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,161 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=692) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 434
02.12.2021 17:25:17,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,196 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:17,222 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239112ms for 240000ms of delay, sleeping for 898ms
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 119
02.12.2021 17:25:17,245 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239190ms for 240000ms of delay, sleeping for 820ms
02.12.2021 17:25:17,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,245 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 334
02.12.2021 17:25:17,259 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:17,260 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:17,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:17,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 19
02.12.2021 17:25:17,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 234
02.12.2021 17:25:17,355 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,355 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,356 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=686) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null}
02.12.2021 17:25:17,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 377
02.12.2021 17:25:17,362 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=686): org.apache.kafka.common.requests.HeartbeatResponse@5497b072
02.12.2021 17:25:17,362 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,368 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 56 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a
02.12.2021 17:25:17,368 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:17,369 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:17,369 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 39, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,369 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=687) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 364
02.12.2021 17:25:17,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:17,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 132
02.12.2021 17:25:17,456 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:17,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:17,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 31
02.12.2021 17:25:17,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:17,583 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,584 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:17,584 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=700) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:17,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 65
02.12.2021 17:25:17,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:17,588 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,588 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:17,588 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=676) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:17,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:17,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 108
02.12.2021 17:25:17,591 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=700): org.apache.kafka.common.requests.HeartbeatResponse@1aebe814
02.12.2021 17:25:17,591 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:17,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 57
02.12.2021 17:25:17,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 57
02.12.2021 17:25:17,591 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=676): org.apache.kafka.common.requests.HeartbeatResponse@2fdc91f0
02.12.2021 17:25:17,592 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:17,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 104
02.12.2021 17:25:17,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 104
02.12.2021 17:25:17,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,597 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,648 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,649 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,649 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,649 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,649 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,692 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 4
02.12.2021 17:25:17,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:17,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,699 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,734 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,747 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,748 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:17,800 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:17,857 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:17,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:17,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:18,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:18,021 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59965ms delay out of 60000ms. Remaining 35ms. Executor queue at 0
02.12.2021 17:25:18,022 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59966ms for 60000ms of delay, sleeping for 44ms
02.12.2021 17:25:18,066 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239851ms for 240000ms of delay, sleeping for 159ms
02.12.2021 17:25:18,067 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59999ms for 60000ms of delay, sleeping for 11ms
02.12.2021 17:25:18,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:18,088 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59966ms for 60000ms of delay, sleeping for 44ms
02.12.2021 17:25:18,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:18,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 10 records with 48 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 179911ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:18,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:18,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 49 iterations.
02.12.2021 17:25:18,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 49 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 179912ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:18,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:18,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,127 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=733): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', members=[])
02.12.2021 17:25:18,127 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', members=[])
02.12.2021 17:25:18,128 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:18,128 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}
02.12.2021 17:25:18,131 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:18,131 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=953607, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:18,131 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=953617, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:18,131 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=734) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null,assignments=[]}
02.12.2021 17:25:18,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 4 ms and fetched 10 records
02.12.2021 17:25:18,134 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-8, new queue size is 10
02.12.2021 17:25:18,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,134 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 49 iterations.
02.12.2021 17:25:18,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:18,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:18,135 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142904, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:18,136 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142914, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:18,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:18,136 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:18,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,136 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:18,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:18,137 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59102ms for 60000ms of delay, sleeping for 908ms
02.12.2021 17:25:18,142 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239029ms for 240000ms of delay, sleeping for 981ms
02.12.2021 17:25:18,142 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119986ms for 120000ms of delay, sleeping for 24ms
02.12.2021 17:25:18,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:18,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,158 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,168 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119947ms for 120000ms of delay, sleeping for 63ms
02.12.2021 17:25:18,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:18,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,224 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,233 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239796ms for 240000ms of delay, sleeping for 214ms
02.12.2021 17:25:18,232 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=734): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:18,237 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=56, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}
02.12.2021 17:25:18,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,238 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,243 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119282ms for 120000ms of delay, sleeping for 728ms
02.12.2021 17:25:18,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:18,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,252 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:18,368 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:18,369 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:18,369 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1122) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null}
02.12.2021 17:25:18,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:18,449 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239314ms for 240000ms of delay, sleeping for 696ms
02.12.2021 17:25:18,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:18,470 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1122): org.apache.kafka.common.requests.HeartbeatResponse@79fd5404
02.12.2021 17:25:18,470 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:18,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:18,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:18,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:18,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,608 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:18,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,709 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:18,709 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:18,709 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1400) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null}
02.12.2021 17:25:18,724 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,724 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,725 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,739 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,753 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:18,810 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1400): org.apache.kafka.common.requests.HeartbeatResponse@69020782
02.12.2021 17:25:18,814 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:18,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,863 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:18,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:18,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:18,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 59 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 186996ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:18,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:18,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 60 iterations.
02.12.2021 17:25:18,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 60 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 186996ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:18,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:18,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:18,973 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:18,973 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:18,973 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:18,974 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 87, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 4])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:18,974 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1123) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:18,974 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999200, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:18,975 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999210, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:18,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:18,981 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:18,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,981 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:18,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 60 iterations.
02.12.2021 17:25:18,981 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118948ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:19,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:19,035 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:19,036 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:19,036 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1061) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:19,048 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59911ms for 60000ms of delay, sleeping for 99ms
02.12.2021 17:25:19,064 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:19,071 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:19,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,110 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,125 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239993ms for 240000ms of delay, sleeping for 17ms
02.12.2021 17:25:19,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:19,137 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1061): org.apache.kafka.common.requests.HeartbeatResponse@5913279c
02.12.2021 17:25:19,137 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:19,143 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239897ms for 240000ms of delay, sleeping for 113ms
02.12.2021 17:25:19,150 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59868ms for 60000ms of delay, sleeping for 142ms
02.12.2021 17:25:19,149 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239970ms for 240000ms of delay, sleeping for 40ms
02.12.2021 17:25:19,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,161 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:19,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 200036ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:19,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:19,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 200036ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:19,192 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:19,193 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:19,193 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:19,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 38, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:19,193 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1401) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:19,193 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962748, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:19,193 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962758, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:19,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:19,193 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:19,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,194 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:19,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:19,198 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239791ms for 240000ms of delay, sleeping for 219ms
02.12.2021 17:25:19,218 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:19,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,226 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,240 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,255 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,259 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239451ms for 240000ms of delay, sleeping for 559ms
02.12.2021 17:25:19,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,293 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59636ms for 60000ms of delay, sleeping for 374ms
02.12.2021 17:25:19,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:19,419 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239616ms for 240000ms of delay, sleeping for 394ms
02.12.2021 17:25:19,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:19,463 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:19,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:19,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:19,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,610 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:19,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,669 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59751ms for 60000ms of delay, sleeping for 259ms
02.12.2021 17:25:19,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,726 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,726 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,742 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,758 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,822 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239660ms for 240000ms of delay, sleeping for 350ms
02.12.2021 17:25:19,823 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239737ms for 240000ms of delay, sleeping for 273ms
02.12.2021 17:25:19,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,864 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:19,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:19,952 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59848ms for 60000ms of delay, sleeping for 162ms
02.12.2021 17:25:19,964 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:19,981 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119948ms delay out of 120000ms. Remaining 52ms. Executor queue at 0
02.12.2021 17:25:19,982 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119845ms for 120000ms of delay, sleeping for 165ms
02.12.2021 17:25:20,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:20,064 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:20,097 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239949ms for 240000ms of delay, sleeping for 61ms
02.12.2021 17:25:20,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,112 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,130 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59954ms for 60000ms of delay, sleeping for 56ms
02.12.2021 17:25:20,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:20,156 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119125ms for 120000ms of delay, sleeping for 885ms
02.12.2021 17:25:20,160 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239021ms for 240000ms of delay, sleeping for 989ms
02.12.2021 17:25:20,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,163 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 418
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 10 records with 49 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 181968ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 50 iterations.
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 50 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 181968ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,182 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:20,182 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:20,183 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 38, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 8])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:20,183 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=735) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:20,183 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=953617, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:20,183 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=953627, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:20,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:20,183 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-8, new queue size is 10
02.12.2021 17:25:20,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,183 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 50 iterations.
02.12.2021 17:25:20,184 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239094ms for 240000ms of delay, sleeping for 916ms
02.12.2021 17:25:20,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:20,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:20,188 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142914, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:20,188 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142924, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:20,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:20,189 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:20,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,189 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:20,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:20,189 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59323ms for 60000ms of delay, sleeping for 687ms
02.12.2021 17:25:20,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,227 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 360
02.12.2021 17:25:20,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,243 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,247 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:20,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,259 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:20,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 318
02.12.2021 17:25:20,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 260
02.12.2021 17:25:20,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 218
02.12.2021 17:25:20,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 156
02.12.2021 17:25:20,469 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 114
02.12.2021 17:25:20,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 53
02.12.2021 17:25:20,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 13
02.12.2021 17:25:20,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,584 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,584 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:20,584 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=701) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:20,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:20,584 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=701): org.apache.kafka.common.requests.HeartbeatResponse@7b40ed4d
02.12.2021 17:25:20,584 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:20,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:20,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:20,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,589 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,589 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:20,589 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=677) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:20,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 139
02.12.2021 17:25:20,590 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=677): org.apache.kafka.common.requests.HeartbeatResponse@1eb72468
02.12.2021 17:25:20,590 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:20,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 138
02.12.2021 17:25:20,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 138
02.12.2021 17:25:20,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,613 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,666 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 37
02.12.2021 17:25:20,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:20,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,730 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,760 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,760 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:20,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:20,867 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:20,878 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59732ms for 60000ms of delay, sleeping for 278ms
02.12.2021 17:25:20,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:20,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:21,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:21,048 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118930ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:21,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:21,105 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239180ms for 240000ms of delay, sleeping for 830ms
02.12.2021 17:25:21,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,114 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:21,151 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239015ms for 240000ms of delay, sleeping for 995ms
02.12.2021 17:25:21,158 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58976ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:21,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,166 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,230 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,246 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,261 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:21,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:21,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:21,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:21,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:21,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:21,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:21,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,615 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:21,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,666 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,732 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,747 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,747 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,763 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:21,867 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:21,942 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:21,950 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239669ms for 240000ms of delay, sleeping for 341ms
02.12.2021 17:25:21,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:22,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:22,051 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119933ms delay out of 120000ms. Remaining 67ms. Executor queue at 0
02.12.2021 17:25:22,057 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:22,057 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:22,057 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1062) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:22,061 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119887ms for 120000ms of delay, sleeping for 123ms
02.12.2021 17:25:22,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:22,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,139 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,158 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1062): org.apache.kafka.common.requests.HeartbeatResponse@64b1c850
02.12.2021 17:25:22,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:22,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,168 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:22,183 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239792ms for 240000ms of delay, sleeping for 218ms
02.12.2021 17:25:22,159 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:22,158 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59976ms delay out of 60000ms. Remaining 24ms. Executor queue at 0
02.12.2021 17:25:22,187 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59425ms for 60000ms of delay, sleeping for 585ms
02.12.2021 17:25:22,184 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=687): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', members=[])
02.12.2021 17:25:22,193 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119245ms for 120000ms of delay, sleeping for 765ms
02.12.2021 17:25:22,192 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', members=[])
02.12.2021 17:25:22,204 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:22,204 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}
02.12.2021 17:25:22,204 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,204 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=688) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 43
02.12.2021 17:25:22,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,252 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 523 ms and fetched 0 records
02.12.2021 17:25:22,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,256 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 395
02.12.2021 17:25:22,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:22,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,276 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 10 records with 50 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 184081ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:22,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 51 iterations.
02.12.2021 17:25:22,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 51 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 184081ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:22,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,296 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=735): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', members=[])
02.12.2021 17:25:22,297 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', members=[])
02.12.2021 17:25:22,297 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:22,297 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}
02.12.2021 17:25:22,297 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,297 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=736) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,297 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=953627, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:22,298 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=953637, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:22,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:22,301 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-8, new queue size is 10
02.12.2021 17:25:22,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,301 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 51 iterations.
02.12.2021 17:25:22,302 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239875ms for 240000ms of delay, sleeping for 135ms
02.12.2021 17:25:22,317 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=688): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,318 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,320 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}
02.12.2021 17:25:22,322 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a
02.12.2021 17:25:22,327 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:22,327 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,328 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,329 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:22,329 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,329 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from RUNNING to REBALANCING
02.12.2021 17:25:22,329 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:22,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 435
02.12.2021 17:25:22,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:22,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:22,398 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=736): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,403 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,409 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}
02.12.2021 17:25:22,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:22,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 203253ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 70 iterations.
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 70 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:22,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 203256ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:22,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:22,415 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1401): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', members=[])
02.12.2021 17:25:22,415 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', members=[])
02.12.2021 17:25:22,415 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:22,415 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}
02.12.2021 17:25:22,415 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,415 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1402) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,415 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962758, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:22,416 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962768, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:22,416 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1402): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:22,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:22,417 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:22,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:22,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 70 iterations.
02.12.2021 17:25:22,419 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238754ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:22,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 324
02.12.2021 17:25:22,444 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238545ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:22,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:22,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:22,516 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=57, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}
02.12.2021 17:25:22,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 224
02.12.2021 17:25:22,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:22,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:22,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 122
02.12.2021 17:25:22,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,641 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:22,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,669 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,669 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,676 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=692): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:22,676 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=692): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:22,676 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:22,677 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,677 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:22,677 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,677 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:22,677 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:22,678 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,678 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=693) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:22,678 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,678 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=693) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,679 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 462
02.12.2021 17:25:22,713 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=693): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,713 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,714 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=693): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,714 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,714 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:22,715 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:22,715 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:22,715 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,714 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:22,715 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,719 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:22,719 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,719 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from RUNNING to REBALANCING
02.12.2021 17:25:22,719 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:22,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 63
02.12.2021 17:25:22,715 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:22,719 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:22,719 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,719 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,719 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:22,719 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,719 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:22,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 428
02.12.2021 17:25:22,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 21
02.12.2021 17:25:22,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:22,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,755 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:22,755 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,755 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,755 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:22,755 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:22,755 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,755 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,755 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,755 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from REBALANCING to RUNNING
02.12.2021 17:25:22,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:22,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,756 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,757 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,757 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:22,775 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59891ms for 60000ms of delay, sleeping for 119ms
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,782 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,783 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 322
02.12.2021 17:25:22,857 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:22,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:22,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:22,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:22,898 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59840ms for 60000ms of delay, sleeping for 170ms
02.12.2021 17:25:22,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 221
02.12.2021 17:25:22,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:22,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:22,962 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119753ms for 120000ms of delay, sleeping for 257ms
02.12.2021 17:25:22,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:22,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:23,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 114
02.12.2021 17:25:23,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:23,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:23,077 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59044ms for 60000ms of delay, sleeping for 966ms
02.12.2021 17:25:23,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:23,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 200
02.12.2021 17:25:23,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 4
02.12.2021 17:25:23,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:23,142 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:23,142 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:23,142 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:23,142 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:23,142 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:23,142 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:23,142 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:23,142 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:23,142 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from REBALANCING to RUNNING
02.12.2021 17:25:23,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:23,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,143 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:23,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:23,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,169 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 415
02.12.2021 17:25:23,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:23,220 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119098ms for 120000ms of delay, sleeping for 912ms
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,257 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 332
02.12.2021 17:25:23,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,258 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 314
02.12.2021 17:25:23,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,284 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:23,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 231
02.12.2021 17:25:23,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 214
02.12.2021 17:25:23,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,419 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239754ms delay out of 240000ms. Remaining 246ms. Executor queue at 0
02.12.2021 17:25:23,419 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239261ms for 240000ms of delay, sleeping for 749ms
02.12.2021 17:25:23,445 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239546ms delay out of 240000ms. Remaining 454ms. Executor queue at 1
02.12.2021 17:25:23,446 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239536ms for 240000ms of delay, sleeping for 474ms
02.12.2021 17:25:23,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:23,458 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 131
02.12.2021 17:25:23,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:23,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 114
02.12.2021 17:25:23,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:23,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:23,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 31
02.12.2021 17:25:23,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:23,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 13
02.12.2021 17:25:23,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:23,589 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,589 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=702) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:23,590 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:23,590 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,590 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=678) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:23,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 167
02.12.2021 17:25:23,590 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=678): org.apache.kafka.common.requests.HeartbeatResponse@5e8c4b72
02.12.2021 17:25:23,590 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:23,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 167
02.12.2021 17:25:23,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 167
02.12.2021 17:25:23,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:23,591 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=702): org.apache.kafka.common.requests.HeartbeatResponse@f0e7864
02.12.2021 17:25:23,591 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:23,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 78
02.12.2021 17:25:23,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:23,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,644 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:23,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,669 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:23,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 67
02.12.2021 17:25:23,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:23,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,760 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,760 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,767 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:23,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,784 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:23,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:23,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:23,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:23,925 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239817ms for 240000ms of delay, sleeping for 193ms
02.12.2021 17:25:23,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:23,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:23,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:23,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:23,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:24,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 19 iterations.
02.12.2021 17:25:24,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 19 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:24,049 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142924, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:24,049 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142934, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:24,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:24,050 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:24,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,050 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:24,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 19 iterations.
02.12.2021 17:25:24,051 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59568ms for 60000ms of delay, sleeping for 442ms
02.12.2021 17:25:24,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:24,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:24,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:24,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:24,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:24,122 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239933ms for 240000ms of delay, sleeping for 77ms
02.12.2021 17:25:24,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 60 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 192157ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:24,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:24,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 61 iterations.
02.12.2021 17:25:24,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 61 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 192157ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:24,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:24,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:24,134 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1123): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:24,134 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:24,134 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:24,134 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:24,134 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:24,134 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999210, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:24,134 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999220, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:24,134 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1124) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,assignments=[]}
02.12.2021 17:25:24,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:24,136 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:24,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,136 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:24,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 61 iterations.
02.12.2021 17:25:24,137 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119223ms for 120000ms of delay, sleeping for 787ms
02.12.2021 17:25:24,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:24,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,147 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:24,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:24,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,172 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,172 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,174 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239900ms for 240000ms of delay, sleeping for 110ms
02.12.2021 17:25:24,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:24,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:24,203 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239058ms for 240000ms of delay, sleeping for 952ms
02.12.2021 17:25:24,236 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1124): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:24,236 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=188, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:24,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:24,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,261 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:24,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,273 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:24,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,285 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,286 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239236ms for 240000ms of delay, sleeping for 774ms
02.12.2021 17:25:24,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:24,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:24,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:24,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:24,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:24,494 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59761ms for 60000ms of delay, sleeping for 249ms
02.12.2021 17:25:24,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:24,551 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:24,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:24,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:24,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:24,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:24,649 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,650 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:24,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,672 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,673 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:24,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:24,745 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59819ms for 60000ms of delay, sleeping for 191ms
02.12.2021 17:25:24,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:24,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,762 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,773 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,776 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 428
02.12.2021 17:25:24,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 327
02.12.2021 17:25:24,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:24,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,925 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119977ms for 120000ms of delay, sleeping for 33ms
02.12.2021 17:25:24,938 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59908ms for 60000ms of delay, sleeping for 102ms
02.12.2021 17:25:24,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:24,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:24,972 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119621ms for 120000ms of delay, sleeping for 389ms
02.12.2021 17:25:24,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 217
02.12.2021 17:25:24,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:24,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 293
02.12.2021 17:25:25,041 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59733ms for 60000ms of delay, sleeping for 277ms
02.12.2021 17:25:25,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 92
02.12.2021 17:25:25,061 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239829ms for 240000ms of delay, sleeping for 181ms
02.12.2021 17:25:25,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:25,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 116
02.12.2021 17:25:25,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:25,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:25,106 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,106 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:25,106 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1063) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:25,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,150 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:25,158 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239933ms for 240000ms of delay, sleeping for 77ms
02.12.2021 17:25:25,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:25,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,174 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 16
02.12.2021 17:25:25,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:25,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,205 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,205 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,205 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=689) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null}
02.12.2021 17:25:25,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 71
02.12.2021 17:25:25,206 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=689): org.apache.kafka.common.requests.HeartbeatResponse@4d10319
02.12.2021 17:25:25,206 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,206 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a
02.12.2021 17:25:25,206 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:25,206 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:25,207 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,207 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=690) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,207 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1063): org.apache.kafka.common.requests.HeartbeatResponse@662aed03
02.12.2021 17:25:25,207 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 69
02.12.2021 17:25:25,207 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:25,236 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239404ms for 240000ms of delay, sleeping for 606ms
02.12.2021 17:25:25,243 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239839ms for 240000ms of delay, sleeping for 171ms
02.12.2021 17:25:25,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:25,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,263 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:25,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 389
02.12.2021 17:25:25,306 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:25,315 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,315 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,315 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=737) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null}
02.12.2021 17:25:25,328 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59111ms for 60000ms of delay, sleeping for 899ms
02.12.2021 17:25:25,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:25,363 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119322ms for 120000ms of delay, sleeping for 688ms
02.12.2021 17:25:25,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:25,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:25,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 289
02.12.2021 17:25:25,417 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=737): org.apache.kafka.common.requests.HeartbeatResponse@58d9f60b
02.12.2021 17:25:25,417 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,417 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239558ms for 240000ms of delay, sleeping for 452ms
02.12.2021 17:25:25,436 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,436 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,436 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1403) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null}
02.12.2021 17:25:25,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:25,469 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:25,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:25,489 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 188
02.12.2021 17:25:25,536 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1403): org.apache.kafka.common.requests.HeartbeatResponse@1f928981
02.12.2021 17:25:25,536 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:25,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:25,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:25,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:25,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 88
02.12.2021 17:25:25,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:25,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,654 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 23
02.12.2021 17:25:25,669 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:25,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,674 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,678 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,680 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,680 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=694) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null}
02.12.2021 17:25:25,677 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,681 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,681 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=694) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null}
02.12.2021 17:25:25,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 476
02.12.2021 17:25:25,681 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=694): org.apache.kafka.common.requests.HeartbeatResponse@1acefc4c
02.12.2021 17:25:25,682 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,682 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:25,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 106
02.12.2021 17:25:25,682 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=694): org.apache.kafka.common.requests.HeartbeatResponse@161a59f2
02.12.2021 17:25:25,682 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,682 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:25,683 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:25,683 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:25,683 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 88, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,683 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=695) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 105
02.12.2021 17:25:25,682 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:25,683 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:25,683 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 88, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,683 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=695) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 470
02.12.2021 17:25:25,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:25,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,765 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:25,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30217ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,782 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:25,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,780 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:25,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,788 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:25,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 10 records with 51 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 187643ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:25,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [0_8] and standby tasks [] since 187644ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,868 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347
02.12.2021 17:25:25,868 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:25,869 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:307] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Revoke previously assigned partitions redacted.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:25,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:74] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Current state RUNNING: revoked partitions [redacted.Cloud.Message.Callback.Retry3-8] because of consumer rebalance.
02.12.2021 17:25:25,869 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State transition from RUNNING to PARTITIONS_REVOKED
02.12.2021 17:25:25,869 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from RUNNING to REBALANCING
02.12.2021 17:25:25,869 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Flushing record collector
02.12.2021 17:25:25,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Prepared RUNNING task for committing
02.12.2021 17:25:25,870 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry3-8=OffsetAndMetadata{offset=953637, leaderEpoch=null, metadata='AQAAAX1781rI'}} to coordinator kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,870 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=738) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry3,partitions=[{partition_index=8,committed_offset=953637,committed_leader_epoch=-1,committed_metadata=AQAAAX1781rI}]}]}
02.12.2021 17:25:25,871 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239660ms for 240000ms of delay, sleeping for 350ms
02.12.2021 17:25:25,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:25,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,889 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received OFFSET_COMMIT response from node 2147483643 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=738): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry3', partitions=[OffsetCommitResponsePartition(partitionIndex=8, errorCode=0)])])
02.12.2021 17:25:25,894 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Committed offset 953637 for partition redacted.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:25,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry3-8=953636}
02.12.2021 17:25:25,905 DEBUG [org.apache.kafka.streams.processor.internals.ProcessorStateManager:602] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Writing checkpoint: {}
02.12.2021 17:25:25,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Finalized commit for RUNNING task with eos false enforce checkpoint true
02.12.2021 17:25:25,905 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:297] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Closing processor topology
02.12.2021 17:25:25,906 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.Source.s.destroy
02.12.2021 17:25:25,906 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.Source.s.create
02.12.2021 17:25:25,915 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.Source.s.punctuate
02.12.2021 17:25:25,916 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=process-rate, group=stream-processor-node-metrics, description=The average number of calls to process per second, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8, processor-node-id=Source}]
02.12.2021 17:25:25,916 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=process-total, group=stream-processor-node-metrics, description=The total number of calls to process, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8, processor-node-id=Source}]
02.12.2021 17:25:25,916 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.Source.s.process
02.12.2021 17:25:25,916 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-e2e-latency-avg, group=stream-processor-node-metrics, description=The average end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8, processor-node-id=Source}]
02.12.2021 17:25:25,921 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-e2e-latency-max, group=stream-processor-node-metrics, description=The maximum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8, processor-node-id=Source}]
02.12.2021 17:25:25,921 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-e2e-latency-min, group=stream-processor-node-metrics, description=The minimum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8, processor-node-id=Source}]
02.12.2021 17:25:25,921 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.Source.s.Source-record-e2e-latency
02.12.2021 17:25:25,921 INFO [com.sigfox.kafka.throttleable.ThrottleableStreamProcessor:89] Stream 'staging-message-processor-retry3' task '0_8': pausable processor closing
02.12.2021 17:25:25,922 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.ThrottleableProcessor.s.destroy
02.12.2021 17:25:25,922 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.ThrottleableProcessor.s.create
02.12.2021 17:25:25,922 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.ThrottleableProcessor.s.punctuate
02.12.2021 17:25:25,922 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.ThrottleableProcessor.s.process
02.12.2021 17:25:25,922 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.Processor.s.destroy
02.12.2021 17:25:25,922 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.Processor.s.create
02.12.2021 17:25:25,922 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.Processor.s.punctuate
02.12.2021 17:25:25,922 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.Processor.s.process
02.12.2021 17:25:25,922 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-e2e-latency-avg, group=stream-processor-node-metrics, description=The average end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8, processor-node-id=Processor}]
02.12.2021 17:25:25,926 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-e2e-latency-max, group=stream-processor-node-metrics, description=The maximum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8, processor-node-id=Processor}]
02.12.2021 17:25:25,926 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-e2e-latency-min, group=stream-processor-node-metrics, description=The minimum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8, processor-node-id=Processor}]
02.12.2021 17:25:25,928 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.node.Processor.s.Processor-record-e2e-latency
02.12.2021 17:25:25,928 INFO [org.apache.kafka.streams.processor.internals.StreamTask:278] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Suspended running
02.12.2021 17:25:25,928 INFO [org.apache.kafka.streams.processor.internals.StreamThread:87] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] partition revocation took 59 ms.
02.12.2021 17:25:25,928 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:411] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Need to revoke partitions [redacted.Cloud.Message.Callback.Retry3-8] and re-join the group
02.12.2021 17:25:25,936 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:25,941 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:25,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:384] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Skipped preparing SUSPENDED task for commit since there is nothing to commit
02.12.2021 17:25:25,943 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=process-rate, group=stream-task-metrics, description=The average number of calls to process per second, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,948 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=process-total, group=stream-task-metrics, description=The total number of calls to process, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,951 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.s.process
02.12.2021 17:25:25,951 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-lateness-avg, group=stream-task-metrics, description=The observed average lateness of records in milliseconds, measured by comparing the record timestamp with the current stream time, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,953 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-lateness-max, group=stream-task-metrics, description=The observed maximum lateness of records in milliseconds, measured by comparing the record timestamp with the current stream time, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,954 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.s.record-lateness
02.12.2021 17:25:25,955 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=active-buffer-count, group=stream-task-metrics, description=The count of buffered records that are polled from consumer and not yet processed for this active task, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,956 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.s.active-buffer-count
02.12.2021 17:25:25,957 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=punctuate-latency-avg, group=stream-task-metrics, description=The average latency of calls to punctuate, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,957 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=punctuate-latency-max, group=stream-task-metrics, description=The maximum latency of calls to punctuate, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,957 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=punctuate-rate, group=stream-task-metrics, description=The average number of calls to punctuate per second, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,967 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=punctuate-total, group=stream-task-metrics, description=The total number of calls to punctuate, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,967 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.s.punctuate
02.12.2021 17:25:25,967 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=process-latency-avg, group=stream-task-metrics, description=The average latency of calls to process, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:25,967 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=process-latency-max, group=stream-task-metrics, description=The maximum latency of calls to process, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,977 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.s.process-latency
02.12.2021 17:25:25,977 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=active-process-ratio, group=stream-task-metrics, description=The fraction of time the thread spent on processing this task among all assigned active tasks, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,978 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.s.active-process-ratio
02.12.2021 17:25:25,978 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=enforced-processing-rate, group=stream-task-metrics, description=The average number of occurrences of enforced-processing operations per second, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,978 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=enforced-processing-total, group=stream-task-metrics, description=The total number of occurrences of enforced-processing operations, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,978 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.s.enforced-processing
02.12.2021 17:25:25,978 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=dropped-records-rate, group=stream-task-metrics, description=The average number of dropped records per second, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,978 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=dropped-records-total, group=stream-task-metrics, description=The total number of dropped records, tags={thread-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2, task-id=0_8}]
02.12.2021 17:25:25,978 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2.task.0_8.s.dropped-records
02.12.2021 17:25:25,978 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:127] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Closing state manager for ACTIVE task 0_8
02.12.2021 17:25:25,978 DEBUG [org.apache.kafka.streams.processor.internals.ProcessorStateManager:515] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Closing its state manager and all the registered state stores: {}
02.12.2021 17:25:25,978 INFO [org.apache.kafka.clients.consumer.KafkaConsumer:1070] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-restore-consumer, groupId=null] Unsubscribed all topics or patterns and assigned partitions
02.12.2021 17:25:25,978 INFO [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:258] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Closing record collector clean
02.12.2021 17:25:25,978 INFO [org.apache.kafka.streams.processor.internals.StreamTask:493] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] task [0_8] Closed clean
02.12.2021 17:25:25,978 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:25,978 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State transition from PARTITIONS_REVOKED to PARTITIONS_ASSIGNED
02.12.2021 17:25:25,979 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:25,979 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347
02.12.2021 17:25:25,979 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:25,979 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:25,979 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 39, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,979 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=739) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,979 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:673] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Not returning fetched records for partition redacted.Cloud.Message.Callback.Retry3-8 since it is no longer assigned
02.12.2021 17:25:25,979 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:719] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Draining fetched records for partition redacted.Cloud.Message.Callback.Retry3-8
02.12.2021 17:25:25,980 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=records-lag, group=consumer-fetch-manager-metrics, description=The latest lag of the partition, tags={client-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=8}]
02.12.2021 17:25:25,980 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=records-lag-max, group=consumer-fetch-manager-metrics, description=The max lag of the partition, tags={client-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=8}]
02.12.2021 17:25:25,980 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=records-lag-avg, group=consumer-fetch-manager-metrics, description=The average lag of the partition, tags={client-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=8}]
02.12.2021 17:25:25,980 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name redacted.Cloud.Message.Callback.Retry3-8.records-lag
02.12.2021 17:25:25,980 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=records-lead, group=consumer-fetch-manager-metrics, description=The latest lead of the partition, tags={client-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=8}]
02.12.2021 17:25:25,980 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=records-lead-min, group=consumer-fetch-manager-metrics, description=The min lead of the partition, tags={client-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=8}]
02.12.2021 17:25:25,980 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=records-lead-avg, group=consumer-fetch-manager-metrics, description=The average lead of the partition, tags={client-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=8}]
02.12.2021 17:25:25,980 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name redacted.Cloud.Message.Callback.Retry3-8.records-lead
02.12.2021 17:25:25,981 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=preferred-read-replica, group=consumer-fetch-manager-metrics, description=The current read replica for the partition, or -1 if reading from leader, tags={client-id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=8}]
02.12.2021 17:25:25,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 389
02.12.2021 17:25:25,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:26,020 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:26,063 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118965ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:26,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:26,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:26,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,154 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,176 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 409
02.12.2021 17:25:26,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 70 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 207066ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 71 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 207066ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:26,222 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:26,223 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:26,223 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:26,223 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 39, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:26,223 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1404) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:26,223 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962768, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:26,223 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962778, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:26,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:26,224 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:26,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,224 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:26,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:26,231 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59969ms for 60000ms of delay, sleeping for 41ms
02.12.2021 17:25:26,235 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239361ms for 240000ms of delay, sleeping for 649ms
02.12.2021 17:25:26,238 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:26,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,266 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 324
02.12.2021 17:25:26,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 19 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Committing all active tasks [0_2] and standby tasks [] since 31147ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 307
02.12.2021 17:25:26,278 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Flushing record collector
02.12.2021 17:25:26,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Prepared RUNNING task for committing
02.12.2021 17:25:26,278 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry1-2=OffsetAndMetadata{offset=1142934, leaderEpoch=null, metadata='AQAAAX179huW'}} to coordinator kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,278 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1064) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition_index=2,committed_offset=1142934,committed_leader_epoch=-1,committed_metadata=AQAAAX179huW}]}]}
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30723ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:26,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,301 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received OFFSET_COMMIT response from node 2147483644 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1064): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry1', partitions=[OffsetCommitResponsePartition(partitionIndex=2, errorCode=0)])])
02.12.2021 17:25:26,301 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Committed offset 1142934 for partition redacted.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:26,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry1-2=1142933}
02.12.2021 17:25:26,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:26,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Committed all active tasks [0_2] and standby tasks [] in 0ms
02.12.2021 17:25:26,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:26,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:26,302 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142934, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:26,302 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142944, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:26,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:26,302 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:26,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,302 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:26,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:26,302 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59620ms for 60000ms of delay, sleeping for 390ms
02.12.2021 17:25:26,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 223
02.12.2021 17:25:26,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:26,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:26,370 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:26,370 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:26,371 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:26,371 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from REBALANCING to RUNNING
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [] and standby tasks [] since 188157ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 207
02.12.2021 17:25:26,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 123
02.12.2021 17:25:26,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 107
02.12.2021 17:25:26,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 23
02.12.2021 17:25:26,579 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 6
02.12.2021 17:25:26,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,587 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,588 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,589 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=703) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:26,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,589 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=703): org.apache.kafka.common.requests.HeartbeatResponse@6f840e91
02.12.2021 17:25:26,590 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:26,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:26,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:26,590 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,591 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,591 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=679) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:26,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,592 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=679): org.apache.kafka.common.requests.HeartbeatResponse@1910b118
02.12.2021 17:25:26,592 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:26,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 174
02.12.2021 17:25:26,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 174
02.12.2021 17:25:26,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,656 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,657 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,677 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 74
02.12.2021 17:25:26,695 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59947ms for 60000ms of delay, sleeping for 63ms
02.12.2021 17:25:26,760 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58883ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:26,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:26,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,772 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:26,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:26,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,788 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31227ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,793 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,872 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:26,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,872 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:26,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [] and standby tasks [] since 188659ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:26,886 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239833ms for 240000ms of delay, sleeping for 177ms
02.12.2021 17:25:26,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:26,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:27,063 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119965ms delay out of 120000ms. Remaining 35ms. Executor queue at 0
02.12.2021 17:25:27,065 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119946ms for 120000ms of delay, sleeping for 64ms
02.12.2021 17:25:27,065 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239852ms for 240000ms of delay, sleeping for 158ms
02.12.2021 17:25:27,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:27,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:27,132 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119997ms for 120000ms of delay, sleeping for 13ms
02.12.2021 17:25:27,146 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119866ms for 120000ms of delay, sleeping for 144ms
02.12.2021 17:25:27,151 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:27,151 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:27,151 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1125) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null}
02.12.2021 17:25:27,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,158 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:27,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,178 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,225 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239099ms for 240000ms of delay, sleeping for 911ms
02.12.2021 17:25:27,251 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1125): org.apache.kafka.common.requests.HeartbeatResponse@581d271f
02.12.2021 17:25:27,252 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:27,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,273 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,289 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31728ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,294 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,294 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118925ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:27,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,374 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:27,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [] and standby tasks [] since 189160ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:27,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:27,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:27,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:27,579 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:27,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,659 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:27,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,679 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,761 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59884ms delay out of 60000ms. Remaining 116ms. Executor queue at 0
02.12.2021 17:25:27,763 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59606ms for 60000ms of delay, sleeping for 404ms
02.12.2021 17:25:27,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:27,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,775 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,790 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32229ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,791 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,797 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,878 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:27,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [] and standby tasks [] since 189664ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:27,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:27,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:28,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:28,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:28,115 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:28,125 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:28,125 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1065) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:28,144 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239650ms for 240000ms of delay, sleeping for 360ms
02.12.2021 17:25:28,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,159 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,168 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59959ms for 60000ms of delay, sleeping for 51ms
02.12.2021 17:25:28,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:28,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,184 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:28,221 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59157ms for 60000ms of delay, sleeping for 853ms
02.12.2021 17:25:28,226 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1065): org.apache.kafka.common.requests.HeartbeatResponse@2b40b53c
02.12.2021 17:25:28,226 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:28,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,276 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:28,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,292 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32731ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,295 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119926ms delay out of 120000ms. Remaining 74ms. Executor queue at 0
02.12.2021 17:25:28,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 61 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 196320ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 62 iterations.
02.12.2021 17:25:28,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 62 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 196320ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:28,296 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:28,297 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:28,297 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:28,297 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 88, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 4])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:28,297 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1126) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:28,298 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999220, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:28,298 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999230, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:28,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:28,299 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:28,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,299 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:28,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 62 iterations.
02.12.2021 17:25:28,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,300 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,300 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,302 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119507ms for 120000ms of delay, sleeping for 503ms
02.12.2021 17:25:28,370 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:28,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:28,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,379 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:28,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [] and standby tasks [] since 190165ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:28,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:28,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:28,505 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239620ms for 240000ms of delay, sleeping for 390ms
02.12.2021 17:25:28,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:28,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:28,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,661 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:28,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,685 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,777 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:28,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,793 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33232ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,801 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,806 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119651ms for 120000ms of delay, sleeping for 359ms
02.12.2021 17:25:28,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:28,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:28,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:28,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,895 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:28,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [] and standby tasks [] since 190682ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,897 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239011ms for 240000ms of delay, sleeping for 999ms
02.12.2021 17:25:28,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:28,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:28,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:29,076 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59301ms for 60000ms of delay, sleeping for 709ms
02.12.2021 17:25:29,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:29,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:29,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,162 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,169 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119507ms for 120000ms of delay, sleeping for 503ms
02.12.2021 17:25:29,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:29,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,187 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:29,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,277 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 313
02.12.2021 17:25:29,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:29,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,294 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33733ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,302 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 212
02.12.2021 17:25:29,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:29,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,397 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:29,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [] and standby tasks [] since 191184ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 112
02.12.2021 17:25:29,489 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:29,579 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 11
02.12.2021 17:25:29,588 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,588 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:29,588 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=704) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:29,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:29,588 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=704): org.apache.kafka.common.requests.HeartbeatResponse@2a6ae03d
02.12.2021 17:25:29,588 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:29,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:29,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:29,590 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,590 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:29,590 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=680) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:29,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:29,591 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=680): org.apache.kafka.common.requests.HeartbeatResponse@5208e0db
02.12.2021 17:25:29,591 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:29,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:29,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:29,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,663 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,673 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119566ms for 120000ms of delay, sleeping for 444ms
02.12.2021 17:25:29,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,687 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=695): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:29,706 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=696) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,assignments=[]}
02.12.2021 17:25:29,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=695): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:29,707 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=696) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,assignments=[]}
02.12.2021 17:25:29,708 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 455
02.12.2021 17:25:29,767 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=696): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,767 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,767 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=189, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:29,767 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 189 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:29,767 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=696): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,767 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:29,767 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:29,767 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,768 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=189, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:29,767 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:29,768 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 189 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:29,768 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:29,768 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:29,768 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:29,768 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:29,768 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:29,768 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:29,768 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from RUNNING to REBALANCING
02.12.2021 17:25:29,768 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:29,769 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 35
02.12.2021 17:25:29,768 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:29,769 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:29,769 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 396
02.12.2021 17:25:29,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,778 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,787 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59689ms for 60000ms of delay, sleeping for 321ms
02.12.2021 17:25:29,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:29,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,800 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Committing all active tasks [] and standby tasks [] since 34240ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:29,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:29,804 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:29,804 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:29,804 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:29,805 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:29,805 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:29,805 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:29,805 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:29,805 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:29,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:29,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,805 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 291
02.12.2021 17:25:29,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:29,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:29,898 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [] and standby tasks [] since 191691ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 71 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 210749ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:29,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 210750ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:29,906 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962778, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:29,906 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962788, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:29,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:29,906 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:29,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,906 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:29,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:29,907 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239886ms for 240000ms of delay, sleeping for 124ms
02.12.2021 17:25:29,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:29,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 183
02.12.2021 17:25:29,985 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:30,003 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:30,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:30,037 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239839ms for 240000ms of delay, sleeping for 171ms
02.12.2021 17:25:30,094 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:30,085 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 78
02.12.2021 17:25:30,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:30,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:30,116 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59240ms for 60000ms of delay, sleeping for 770ms
02.12.2021 17:25:30,138 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119962ms for 120000ms of delay, sleeping for 48ms
02.12.2021 17:25:30,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 513 ms and fetched 0 records
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,177 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,177 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from REBALANCING to RUNNING
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:30,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,194 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:30,196 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119058ms for 120000ms of delay, sleeping for 952ms
02.12.2021 17:25:30,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,214 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239956ms for 240000ms of delay, sleeping for 54ms
02.12.2021 17:25:30,219 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:30,270 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239367ms for 240000ms of delay, sleeping for 643ms
02.12.2021 17:25:30,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,279 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:30,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,302 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Committing all active tasks [] and standby tasks [] since 34741ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:30,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,303 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:30,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,324 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:30,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:30,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=690): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', members=[])
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', members=[])
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,408 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=691) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,408 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=739): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', members=[])
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', members=[])
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,409 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=740) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 395
02.12.2021 17:25:30,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [] and standby tasks [] since 192195ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:30,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,410 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,447 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=740): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,447 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=691): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,447 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,447 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}
02.12.2021 17:25:30,447 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,447 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347
02.12.2021 17:25:30,447 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}
02.12.2021 17:25:30,448 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,448 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a
02.12.2021 17:25:30,448 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,448 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,448 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,448 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:30,448 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,448 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,448 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:30,449 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from RUNNING to REBALANCING
02.12.2021 17:25:30,449 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 356
02.12.2021 17:25:30,449 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,450 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,450 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 463
02.12.2021 17:25:30,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:30,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:30,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:30,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:30,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 253
02.12.2021 17:25:30,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 357
02.12.2021 17:25:30,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:30,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:30,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:30,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:30,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 152
02.12.2021 17:25:30,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 257
02.12.2021 17:25:30,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,678 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:30,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:30,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 52
02.12.2021 17:25:30,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 157
02.12.2021 17:25:30,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,780 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,796 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:30,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,804 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:30,804 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,804 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,804 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:30,805 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:30,805 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,805 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,805 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:30,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,805 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Committing all active tasks [] and standby tasks [] since 35244ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:30,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,830 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 56
02.12.2021 17:25:30,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:30,880 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 9 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:30,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:30,891 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58834ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:30,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:30,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:30,914 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238808ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,916 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,916 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from REBALANCING to RUNNING
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Committing all active tasks [] and standby tasks [] since 192702ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:30,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:30,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:31,006 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:31,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:31,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:31,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:31,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:31,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:31,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:31,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:31,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:31,134 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:31,134 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:31,134 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1066) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:31,153 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119194ms for 120000ms of delay, sleeping for 816ms
02.12.2021 17:25:31,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,179 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,179 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:31,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:31,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:31,234 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1066): org.apache.kafka.common.requests.HeartbeatResponse@6baf480f
02.12.2021 17:25:31,234 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:31,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:31,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,280 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:31,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:31,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,310 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,319 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:31,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,340 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:31,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:31,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:31,410 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:31,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,418 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:31,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:31,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:31,483 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:31,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:31,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:31,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:31,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:31,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:31,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:31,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:31,618 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:31,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:31,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:31,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,679 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,679 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:31,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,698 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:31,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:31,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:31,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,798 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:31,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,813 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:31,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,847 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:31,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:31,891 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59834ms delay out of 60000ms. Remaining 166ms. Executor queue at 0
02.12.2021 17:25:31,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 1 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:31,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:31,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:31,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:31,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:31,900 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142944, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:31,901 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142954, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:31,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 4 ms and fetched 10 records
02.12.2021 17:25:31,908 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:31,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,908 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:31,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:31,908 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59768ms for 60000ms of delay, sleeping for 242ms
02.12.2021 17:25:31,914 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239808ms delay out of 240000ms. Remaining 192ms. Executor queue at 1
02.12.2021 17:25:31,917 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239688ms for 240000ms of delay, sleeping for 322ms
02.12.2021 17:25:31,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:31,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,926 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:31,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:31,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:31,975 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118863ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:31,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:31,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:31,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:32,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 289
02.12.2021 17:25:32,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:32,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:32,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 92
02.12.2021 17:25:32,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:32,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:32,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 189
02.12.2021 17:25:32,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:32,164 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59209ms for 60000ms of delay, sleeping for 801ms
02.12.2021 17:25:32,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:32,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,183 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:32,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:32,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,200 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,201 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 388
02.12.2021 17:25:32,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:32,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 88
02.12.2021 17:25:32,245 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239358ms for 240000ms of delay, sleeping for 652ms
02.12.2021 17:25:32,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:32,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:32,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,284 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 304
02.12.2021 17:25:32,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:32,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 287
02.12.2021 17:25:32,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:32,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,331 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:32,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,352 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 353
02.12.2021 17:25:32,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 204
02.12.2021 17:25:32,391 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:32,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:32,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,428 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:32,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,428 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:32,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 253
02.12.2021 17:25:32,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 103
02.12.2021 17:25:32,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:32,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:32,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:32,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:32,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 153
02.12.2021 17:25:32,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 3
02.12.2021 17:25:32,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,588 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,589 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,589 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=705) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:32,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 111
02.12.2021 17:25:32,590 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=705): org.apache.kafka.common.requests.HeartbeatResponse@563c4ab8
02.12.2021 17:25:32,590 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:32,590 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,590 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,590 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=681) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:32,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:32,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 110
02.12.2021 17:25:32,591 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=681): org.apache.kafka.common.requests.HeartbeatResponse@75bb0a96
02.12.2021 17:25:32,591 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:32,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:32,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 109
02.12.2021 17:25:32,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:32,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:32,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:32,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:32,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 52
02.12.2021 17:25:32,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:32,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 9
02.12.2021 17:25:32,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,692 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,693 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 11
02.12.2021 17:25:32,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,702 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,706 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,710 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,709 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,711 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,711 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=697) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null}
02.12.2021 17:25:32,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 488
02.12.2021 17:25:32,712 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=697): org.apache.kafka.common.requests.HeartbeatResponse@52499dec
02.12.2021 17:25:32,712 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:32,713 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 189 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:32,710 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=697) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null}
02.12.2021 17:25:32,713 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:32,716 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:32,716 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 89, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,716 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=698) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:32,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 143
02.12.2021 17:25:32,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 480
02.12.2021 17:25:32,720 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=697): org.apache.kafka.common.requests.HeartbeatResponse@357053da
02.12.2021 17:25:32,725 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:32,725 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 189 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:32,725 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:32,729 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:32,730 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 89, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,730 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=698) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:32,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 123
02.12.2021 17:25:32,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:32,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:32,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,787 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:32,812 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:32,815 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:32,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,832 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,835 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:32,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:32,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,861 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,888 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:32,898 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238982ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:32,903 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:32,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:32,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:32,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,941 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:32,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,942 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 467
02.12.2021 17:25:32,975 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119863ms delay out of 120000ms. Remaining 137ms. Executor queue at 0
02.12.2021 17:25:32,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 62 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 201000ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:32,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:32,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 63 iterations.
02.12.2021 17:25:32,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 63 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 201000ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:32,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:32,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:32,977 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1126): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:32,977 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:32,977 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:32,978 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:32,978 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:32,978 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999230, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:32,978 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999240, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:32,978 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1127) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,assignments=[]}
02.12.2021 17:25:32,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:32,980 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:32,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,980 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:32,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 63 iterations.
02.12.2021 17:25:32,980 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119518ms for 120000ms of delay, sleeping for 492ms
02.12.2021 17:25:32,980 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59423ms for 60000ms of delay, sleeping for 587ms
02.12.2021 17:25:32,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:33,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:33,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:33,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 366
02.12.2021 17:25:33,079 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1127): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:33,079 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=189, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:33,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:33,105 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:33,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:33,144 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 265
02.12.2021 17:25:33,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:33,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,202 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:33,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,203 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:33,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 165
02.12.2021 17:25:33,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,289 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,303 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,334 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 74
02.12.2021 17:25:33,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 64
02.12.2021 17:25:33,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,365 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:33,408 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,408 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,408 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=692) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null}
02.12.2021 17:25:33,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 426
02.12.2021 17:25:33,409 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=692): org.apache.kafka.common.requests.HeartbeatResponse@7bf87d24
02.12.2021 17:25:33,409 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:33,409 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a
02.12.2021 17:25:33,409 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:33,409 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:33,409 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 41, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,409 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=693) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:33,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 425
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,417 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,417 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,417 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=741) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null}
02.12.2021 17:25:33,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 27
02.12.2021 17:25:33,418 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=741): org.apache.kafka.common.requests.HeartbeatResponse@54669a62
02.12.2021 17:25:33,418 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:33,418 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347
02.12.2021 17:25:33,418 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:33,418 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:33,418 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,418 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=742) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:33,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 24
02.12.2021 17:25:33,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,443 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:33,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,474 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119821ms for 120000ms of delay, sleeping for 189ms
02.12.2021 17:25:33,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:33,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:33,509 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:33,517 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:33,569 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59467ms for 60000ms of delay, sleeping for 543ms
02.12.2021 17:25:33,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:33,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:33,666 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119564ms for 120000ms of delay, sleeping for 446ms
02.12.2021 17:25:33,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,704 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,789 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:33,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,835 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,896 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,899 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239983ms delay out of 240000ms. Remaining 17ms. Executor queue at 0
02.12.2021 17:25:33,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:33,968 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239804ms for 240000ms of delay, sleeping for 206ms
02.12.2021 17:25:33,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:33,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,994 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:33,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,053 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 151
02.12.2021 17:25:34,094 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:34,129 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119946ms for 120000ms of delay, sleeping for 64ms
02.12.2021 17:25:34,144 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:34,144 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:34,144 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1067) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:34,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 50
02.12.2021 17:25:34,164 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59146ms for 60000ms of delay, sleeping for 864ms
02.12.2021 17:25:34,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 215021ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:34,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:34,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 73 iterations.
02.12.2021 17:25:34,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 73 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 215025ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:34,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:34,186 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1404): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', members=[])
02.12.2021 17:25:34,188 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', members=[])
02.12.2021 17:25:34,188 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:34,188 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}
02.12.2021 17:25:34,188 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:34,188 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962788, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:34,188 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962798, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:34,188 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1405) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:34,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 7 ms and fetched 10 records
02.12.2021 17:25:34,194 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:34,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,194 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:34,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 73 iterations.
02.12.2021 17:25:34,200 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239656ms for 240000ms of delay, sleeping for 354ms
02.12.2021 17:25:34,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,208 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,208 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119246ms for 120000ms of delay, sleeping for 764ms
02.12.2021 17:25:34,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 513 ms and fetched 0 records
02.12.2021 17:25:34,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,219 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,219 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 66
02.12.2021 17:25:34,244 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1067): org.apache.kafka.common.requests.HeartbeatResponse@1b6fe62
02.12.2021 17:25:34,245 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:34,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,291 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,291 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1405): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:34,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,291 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=58, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}
02.12.2021 17:25:34,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:34,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:34,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,345 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:34,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:34,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,406 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:34,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:34,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,495 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:34,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:34,559 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239361ms for 240000ms of delay, sleeping for 649ms
02.12.2021 17:25:34,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:34,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:34,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:34,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,708 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,720 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,792 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,792 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,847 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,908 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,908 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:34,974 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119507ms for 120000ms of delay, sleeping for 503ms
02.12.2021 17:25:34,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:34,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,996 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:34,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:35,030 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59308ms for 60000ms of delay, sleeping for 702ms
02.12.2021 17:25:35,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:35,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:35,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:35,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,210 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,210 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,212 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239089ms for 240000ms of delay, sleeping for 921ms
02.12.2021 17:25:35,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,220 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 366
02.12.2021 17:25:35,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,292 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:35,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 264
02.12.2021 17:25:35,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:35,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,352 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:35,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,409 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 162
02.12.2021 17:25:35,478 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119463ms for 120000ms of delay, sleeping for 547ms
02.12.2021 17:25:35,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:35,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,497 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:35,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 62
02.12.2021 17:25:35,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,590 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,590 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:35,590 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=706) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:35,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 132
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=706): org.apache.kafka.common.requests.HeartbeatResponse@2a8dd543
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:35,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 131
02.12.2021 17:25:35,591 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:35,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 131
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=682) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:35,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 201
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=682): org.apache.kafka.common.requests.HeartbeatResponse@49501888
02.12.2021 17:25:35,592 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:35,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:35,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:35,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 31
02.12.2021 17:25:35,692 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 100
02.12.2021 17:25:35,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,712 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,723 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,723 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:35,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:35,741 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 7 fetched records at offset FetchPosition{offset=1142954, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:35,741 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142961, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:35,741 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:1199] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Added READ_UNCOMMITTED fetch request for partition redacted.Cloud.Message.Callback.Retry1-2 at position FetchPosition{offset=1142961, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null)], epoch=absent}} to node kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null)
02.12.2021 17:25:35,741 DEBUG [org.apache.kafka.clients.FetchSessionHandler:259] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Built incremental fetch (sessionId=2098113765, epoch=200) for node 3. Added (), altered (redacted.Cloud.Message.Callback.Retry1-2), removed () out of (OSS.STAGING.Cloud.Message.Callback.Retry1-2)
02.12.2021 17:25:35,741 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:266] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(redacted.Cloud.Message.Callback.Retry1-2), toForget=(), implied=()) to broker kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null)
02.12.2021 17:25:35,741 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending FETCH request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1068) and timeout 30000 to node 3: {replica_id=-1,max_wait_ms=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=2098113765,session_epoch=200,topics=[{topic=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition=2,current_leader_epoch=-1,fetch_offset=1142961,log_start_offset=-1,partition_max_bytes=1048576}]}],forgotten_topics_data=[],rack_id=}
02.12.2021 17:25:35,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 7 records
02.12.2021 17:25:35,742 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 7
02.12.2021 17:25:35,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,742 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:35,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:35,743 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59648ms for 60000ms of delay, sleeping for 362ms
02.12.2021 17:25:35,749 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received FETCH response from node 3 for request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1068): org.apache.kafka.common.requests.FetchResponse@30c559a2
02.12.2021 17:25:35,749 DEBUG [org.apache.kafka.clients.FetchSessionHandler:463] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Node 3 sent an incremental fetch response with throttleTimeMs = 0 for session 2098113765 with response=(redacted.Cloud.Message.Callback.Retry1-2)
02.12.2021 17:25:35,749 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:315] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Fetch READ_UNCOMMITTED at offset 1142961 for partition redacted.Cloud.Message.Callback.Retry1-2 returned fetch data (error=NONE, highWaterMark=1143120, lastStableOffset = 1143120, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, divergingEpoch =Optional.empty, recordsSizeInBytes=72168)
02.12.2021 17:25:35,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,801 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,823 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:35,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,854 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 392
02.12.2021 17:25:35,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,918 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:35,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,990 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,992 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:35,992 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1128) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null}
02.12.2021 17:25:35,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,000 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:36,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:36,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 63 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 204050ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:36,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:36,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:36,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 64 iterations.
02.12.2021 17:25:36,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 64 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 204056ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:36,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:36,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:36,032 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1128): org.apache.kafka.common.requests.HeartbeatResponse@1e1d6352
02.12.2021 17:25:36,032 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:36,032 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:36,032 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:36,033 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:36,033 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 89, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 4])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:36,033 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1129) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:36,033 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999240, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:36,033 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999250, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:36,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:36,033 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:36,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,033 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:36,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 64 iterations.
02.12.2021 17:25:36,034 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119702ms for 120000ms of delay, sleeping for 308ms
02.12.2021 17:25:36,093 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:36,107 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59953ms for 60000ms of delay, sleeping for 57ms
02.12.2021 17:25:36,108 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=698): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:36,108 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:36,109 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:36,109 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:36,109 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:36,109 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=699) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,assignments=[]}
02.12.2021 17:25:36,109 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 325
02.12.2021 17:25:36,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:36,119 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=698): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:36,120 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:36,120 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:36,120 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:36,120 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:36,120 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=699) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,assignments=[]}
02.12.2021 17:25:36,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 92
02.12.2021 17:25:36,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:36,135 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239973ms for 240000ms of delay, sleeping for 37ms
02.12.2021 17:25:36,167 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59355ms for 60000ms of delay, sleeping for 655ms
02.12.2021 17:25:36,174 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239988ms for 240000ms of delay, sleeping for 22ms
02.12.2021 17:25:36,197 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239261ms for 240000ms of delay, sleeping for 749ms
02.12.2021 17:25:36,210 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=699): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,210 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=699): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,211 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,211 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,212 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=190, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:36,211 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=190, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:36,212 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 190 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:36,212 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:36,212 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:36,212 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 190 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:36,213 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:36,213 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:36,213 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:36,214 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:36,214 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:36,214 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from RUNNING to REBALANCING
02.12.2021 17:25:36,213 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:36,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:36,215 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:36,216 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:36,214 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:36,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 223
02.12.2021 17:25:36,216 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:36,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 1
02.12.2021 17:25:36,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:36,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:36,219 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:36,219 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:36,219 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:36,219 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:36,220 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,223 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,305 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 117
02.12.2021 17:25:36,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:36,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:36,345 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119536ms for 120000ms of delay, sleeping for 474ms
02.12.2021 17:25:36,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,364 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,408 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:36,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 17
02.12.2021 17:25:36,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:36,428 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:36,435 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:36,435 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from REBALANCING to RUNNING
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:36,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:36,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,515 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:36,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:36,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:36,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:36,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:36,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:36,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:36,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:36,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:36,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,720 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:36,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,726 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:36,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,806 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,807 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:36,823 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119827ms for 120000ms of delay, sleeping for 183ms
02.12.2021 17:25:36,825 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59740ms for 60000ms of delay, sleeping for 270ms
02.12.2021 17:25:36,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,848 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 87
02.12.2021 17:25:36,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,865 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:36,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:36,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,935 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,935 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 73 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 217792ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 74 iterations.
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 74 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 217792ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:36,948 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:36,948 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:36,948 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1406) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:36,949 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962798, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:36,949 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962808, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:36,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:36,949 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:36,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,949 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:36,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 74 iterations.
02.12.2021 17:25:36,954 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239063ms for 240000ms of delay, sleeping for 947ms
02.12.2021 17:25:37,003 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:37,007 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119990ms for 120000ms of delay, sleeping for 20ms
02.12.2021 17:25:37,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:37,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,015 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:37,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:37,029 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119195ms for 120000ms of delay, sleeping for 815ms
02.12.2021 17:25:37,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:37,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:37,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 7 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:37,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:37,097 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1251] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Preparing to read 72168 bytes of data for partition redacted.Cloud.Message.Callback.Retry1-2 with offset FetchPosition{offset=1142961, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null)], epoch=absent}}
02.12.2021 17:25:37,097 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1275] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating high watermark for partition redacted.Cloud.Message.Callback.Retry1-2 to 1143120
02.12.2021 17:25:37,097 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1280] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating log start offset for partition redacted.Cloud.Message.Callback.Retry1-2 to 0
02.12.2021 17:25:37,097 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1285] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating last stable offset for partition redacted.Cloud.Message.Callback.Retry1-2 to 1143120
02.12.2021 17:25:37,097 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142961, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:37,097 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142971, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:37,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:37,098 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:37,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,098 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:37,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:37,099 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 56778ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:37,108 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:37,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:37,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:37,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:37,154 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:37,154 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:37,154 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1069) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:37,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30221ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:37,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,229 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:37,256 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1069): org.apache.kafka.common.requests.HeartbeatResponse@1e82f3d3
02.12.2021 17:25:37,256 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:37,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,314 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,316 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:37,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:37,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:37,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,366 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:37,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:37,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:37,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,436 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30266ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:37,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,516 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:37,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:37,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:37,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:37,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:37,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:37,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 88
02.12.2021 17:25:37,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:37,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:37,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,723 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,724 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,724 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:37,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,729 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:37,770 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=742): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', members=[])
02.12.2021 17:25:37,770 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=693): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', members=[])
02.12.2021 17:25:37,770 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', members=[])
02.12.2021 17:25:37,772 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,772 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}
02.12.2021 17:25:37,772 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,772 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=743) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 245
02.12.2021 17:25:37,772 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', members=[])
02.12.2021 17:25:37,777 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,777 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}
02.12.2021 17:25:37,777 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,778 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=694) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 85
02.12.2021 17:25:37,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:37,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:37,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:37,849 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119859ms for 120000ms of delay, sleeping for 151ms
02.12.2021 17:25:37,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 516 ms and fetched 0 records
02.12.2021 17:25:37,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,897 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,922 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239026ms for 240000ms of delay, sleeping for 984ms
02.12.2021 17:25:37,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:37,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:37,942 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 394
02.12.2021 17:25:37,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,954 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 176
02.12.2021 17:25:38,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:38,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,050 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 281
02.12.2021 17:25:38,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:38,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:38,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,060 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,064 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119626ms for 120000ms of delay, sleeping for 384ms
02.12.2021 17:25:38,099 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 57778ms delay out of 60000ms. Remaining 2222ms. Executor queue at 0
02.12.2021 17:25:38,100 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57201ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:38,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 177
02.12.2021 17:25:38,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 65
02.12.2021 17:25:38,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 72
02.12.2021 17:25:38,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:38,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,225 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:38,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,233 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 357
02.12.2021 17:25:38,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:38,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:38,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:38,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 256
02.12.2021 17:25:38,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:38,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,346 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 239
02.12.2021 17:25:38,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:38,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,399 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,399 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:38,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 155
02.12.2021 17:25:38,449 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119687ms for 120000ms of delay, sleeping for 323ms
02.12.2021 17:25:38,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 134
02.12.2021 17:25:38,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:38,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,459 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:38,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 55
02.12.2021 17:25:38,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 33
02.12.2021 17:25:38,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:38,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,561 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:38,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,561 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,592 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:38,592 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=707) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:38,593 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,593 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:38,593 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=707): org.apache.kafka.common.requests.HeartbeatResponse@6532a605
02.12.2021 17:25:38,593 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=683) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:38,593 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:38,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 140
02.12.2021 17:25:38,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 140
02.12.2021 17:25:38,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 260
02.12.2021 17:25:38,594 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=683): org.apache.kafka.common.requests.HeartbeatResponse@55d4e8cb
02.12.2021 17:25:38,594 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:38,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 258
02.12.2021 17:25:38,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 258
02.12.2021 17:25:38,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:38,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:38,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 158
02.12.2021 17:25:38,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 39
02.12.2021 17:25:38,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,726 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,726 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 394
02.12.2021 17:25:38,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,736 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,760 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:38,775 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119994ms for 120000ms of delay, sleeping for 16ms
02.12.2021 17:25:38,793 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119709ms for 120000ms of delay, sleeping for 301ms
02.12.2021 17:25:38,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 58
02.12.2021 17:25:38,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:38,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:38,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:38,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:38,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,864 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,900 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,907 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239943ms for 240000ms of delay, sleeping for 67ms
02.12.2021 17:25:38,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:38,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 288
02.12.2021 17:25:38,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,961 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 148
02.12.2021 17:25:38,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:38,981 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239799ms for 240000ms of delay, sleeping for 211ms
02.12.2021 17:25:39,029 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:39,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:39,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 47
02.12.2021 17:25:39,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,062 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:39,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,062 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:39,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 64 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:39,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 207119ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:39,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:39,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:39,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:39,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 207120ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:39,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:39,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:39,097 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1129): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:39,097 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:39,097 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:39,097 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:39,097 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:39,098 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999250, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:39,098 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999260, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:39,098 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1130) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,assignments=[]}
02.12.2021 17:25:39,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:39,098 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:39,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,098 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:39,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:39,099 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119863ms for 120000ms of delay, sleeping for 147ms
02.12.2021 17:25:39,100 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58201ms delay out of 60000ms. Remaining 1799ms. Executor queue at 1
02.12.2021 17:25:39,101 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57892ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:39,109 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:39,110 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:39,110 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=700) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null}
02.12.2021 17:25:39,109 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 351
02.12.2021 17:25:39,111 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=700): org.apache.kafka.common.requests.HeartbeatResponse@12a521
02.12.2021 17:25:39,113 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:39,113 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 190 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:39,113 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:39,113 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:39,113 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 90, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:39,113 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=701) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:39,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 348
02.12.2021 17:25:39,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:39,121 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:39,121 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:39,121 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=700) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null}
02.12.2021 17:25:39,122 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 105
02.12.2021 17:25:39,122 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=700): org.apache.kafka.common.requests.HeartbeatResponse@2f906814
02.12.2021 17:25:39,122 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:39,122 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 190 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:39,122 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:39,122 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:39,122 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 90, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:39,123 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=701) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:39,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 103
02.12.2021 17:25:39,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:39,179 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:39,194 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238906ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:39,198 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1130): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:39,199 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=190, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:39,210 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:39,222 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:39,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,226 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,237 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,247 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119856ms for 120000ms of delay, sleeping for 154ms
02.12.2021 17:25:39,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:39,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 514 ms and fetched 0 records
02.12.2021 17:25:39,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,379 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,401 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,402 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119500ms for 120000ms of delay, sleeping for 510ms
02.12.2021 17:25:39,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:39,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,462 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:39,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,563 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:39,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:39,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:39,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:39,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,727 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,738 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:39,838 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,888 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:39,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,908 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,913 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119538ms for 120000ms of delay, sleeping for 472ms
02.12.2021 17:25:39,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:39,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,963 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:40,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,101 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58892ms delay out of 60000ms. Remaining 1108ms. Executor queue at 2
02.12.2021 17:25:40,106 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58050ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:40,108 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:40,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:40,172 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,172 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:40,172 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1070) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:40,194 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239906ms delay out of 240000ms. Remaining 94ms. Executor queue at 3
02.12.2021 17:25:40,195 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239875ms for 240000ms of delay, sleeping for 135ms
02.12.2021 17:25:40,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:40,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,228 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,239 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,272 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1070): org.apache.kafka.common.requests.HeartbeatResponse@f7c2f3c
02.12.2021 17:25:40,273 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:40,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:40,334 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239863ms for 240000ms of delay, sleeping for 147ms
02.12.2021 17:25:40,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,387 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119557ms for 120000ms of delay, sleeping for 453ms
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,412 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 365
02.12.2021 17:25:40,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:40,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,464 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,482 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239167ms for 240000ms of delay, sleeping for 843ms
02.12.2021 17:25:40,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:40,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,573 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:40,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:40,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:40,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:40,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:40,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:40,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,731 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,773 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,773 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,773 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=744) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null}
02.12.2021 17:25:40,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:40,778 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,778 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,778 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=695) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null}
02.12.2021 17:25:40,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 134
02.12.2021 17:25:40,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:40,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:40,841 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119882ms for 120000ms of delay, sleeping for 128ms
02.12.2021 17:25:40,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,912 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:40,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,915 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:40,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,966 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,971 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119831ms for 120000ms of delay, sleeping for 179ms
02.12.2021 17:25:41,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:41,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:41,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,076 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:41,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,106 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59050ms delay out of 60000ms. Remaining 950ms. Executor queue at 1
02.12.2021 17:25:41,107 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59175ms for 60000ms of delay, sleeping for 835ms
02.12.2021 17:25:41,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:41,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:41,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 209179ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:41,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 209179ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:41,155 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:41,155 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:41,155 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:41,159 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 90, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 4])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:41,159 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1131) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:41,159 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999260, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:41,160 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999270, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:41,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:41,160 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:41,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,160 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:41,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:41,164 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119320ms for 120000ms of delay, sleeping for 690ms
02.12.2021 17:25:41,207 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:41,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:41,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,232 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,239 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 352
02.12.2021 17:25:41,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:41,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 74 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 222172ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 75 iterations.
02.12.2021 17:25:41,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 75 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 222172ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:41,329 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1406): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', members=[])
02.12.2021 17:25:41,330 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', members=[])
02.12.2021 17:25:41,330 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:41,330 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}
02.12.2021 17:25:41,331 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,331 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962808, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:41,331 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1407) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,332 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962818, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:41,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:41,335 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:41,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,336 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:41,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 75 iterations.
02.12.2021 17:25:41,337 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239358ms for 240000ms of delay, sleeping for 652ms
02.12.2021 17:25:41,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 251
02.12.2021 17:25:41,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,415 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,416 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 175
02.12.2021 17:25:41,440 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 151
02.12.2021 17:25:41,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,468 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,498 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=701): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:41,499 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:41,498 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=701): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=702) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,499 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,499 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=702) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 468
02.12.2021 17:25:41,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 233
02.12.2021 17:25:41,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 75
02.12.2021 17:25:41,528 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=702): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,528 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=702): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,528 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,528 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=191, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:41,528 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,528 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 191 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:41,528 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=191, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:41,529 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:41,529 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 191 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:41,529 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,529 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:41,529 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,529 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:41,529 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,529 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,529 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from RUNNING to REBALANCING
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:41,529 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:41,530 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,530 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:41,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 204
02.12.2021 17:25:41,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 440
02.12.2021 17:25:41,541 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 51
02.12.2021 17:25:41,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,576 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:41,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,597 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,598 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:41,598 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=684) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:41,597 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,598 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:41,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 320
02.12.2021 17:25:41,598 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=684): org.apache.kafka.common.requests.HeartbeatResponse@404fc492
02.12.2021 17:25:41,598 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:41,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 319
02.12.2021 17:25:41,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 318
02.12.2021 17:25:41,598 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=708) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:41,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 142
02.12.2021 17:25:41,600 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=708): org.apache.kafka.common.requests.HeartbeatResponse@1824c996
02.12.2021 17:25:41,600 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:41,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 139
02.12.2021 17:25:41,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 139
02.12.2021 17:25:41,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 102
02.12.2021 17:25:41,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 338
02.12.2021 17:25:41,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 218
02.12.2021 17:25:41,701 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 38
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,732 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 237
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,798 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=694): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,798 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,799 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=695): org.apache.kafka.common.requests.HeartbeatResponse@4004531b
02.12.2021 17:25:41,798 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=743): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,808 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=744): org.apache.kafka.common.requests.HeartbeatResponse@7203ece3
02.12.2021 17:25:41,809 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,808 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,805 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 116
02.12.2021 17:25:41,817 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}
02.12.2021 17:25:41,817 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a
02.12.2021 17:25:41,817 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,818 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,818 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,818 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,818 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,818 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from RUNNING to REBALANCING
02.12.2021 17:25:41,810 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}
02.12.2021 17:25:41,821 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347
02.12.2021 17:25:41,824 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,824 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,819 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 117
02.12.2021 17:25:41,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 135
02.12.2021 17:25:41,824 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,836 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,836 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,836 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 268
02.12.2021 17:25:41,835 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1407): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,836 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,836 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}
02.12.2021 17:25:41,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:41,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:41,866 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119038ms for 120000ms of delay, sleeping for 972ms
02.12.2021 17:25:41,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,920 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:41,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,933 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:41,934 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 35
02.12.2021 17:25:41,935 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,936 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:41,936 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:41,936 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,936 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,936 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:41,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,937 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:41,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 140
02.12.2021 17:25:41,941 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:41,961 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59980ms for 60000ms of delay, sleeping for 30ms
02.12.2021 17:25:41,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,973 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,973 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from REBALANCING to RUNNING
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,991 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239112ms for 240000ms of delay, sleeping for 898ms
02.12.2021 17:25:42,003 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59998ms for 60000ms of delay, sleeping for 12ms
02.12.2021 17:25:42,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,029 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59202ms for 60000ms of delay, sleeping for 808ms
02.12.2021 17:25:42,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 36
02.12.2021 17:25:42,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:42,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:42,043 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 395
02.12.2021 17:25:42,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:42,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:42,085 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:42,085 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from REBALANCING to RUNNING
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,085 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:42,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:42,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:42,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 281
02.12.2021 17:25:42,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 289
02.12.2021 17:25:42,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:42,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:42,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,236 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,241 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 180
02.12.2021 17:25:42,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 188
02.12.2021 17:25:42,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:42,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:42,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 79
02.12.2021 17:25:42,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 87
02.12.2021 17:25:42,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:42,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:42,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,422 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,438 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 288
02.12.2021 17:25:42,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:42,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,475 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:42,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:42,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 188
02.12.2021 17:25:42,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:42,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,586 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:42,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:42,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 87
02.12.2021 17:25:42,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:42,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:42,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:42,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:42,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:42,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,741 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,746 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,748 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:42,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:42,842 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59800ms for 60000ms of delay, sleeping for 210ms
02.12.2021 17:25:42,842 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:42,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:42,850 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119964ms for 120000ms of delay, sleeping for 46ms
02.12.2021 17:25:42,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:42,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 92
02.12.2021 17:25:42,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:42,893 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239951ms for 240000ms of delay, sleeping for 59ms
02.12.2021 17:25:42,897 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119530ms for 120000ms of delay, sleeping for 480ms
02.12.2021 17:25:42,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:42,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,930 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:42,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,941 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,941 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 293
02.12.2021 17:25:42,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:42,962 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238735ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:42,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:42,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,989 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:43,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:43,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:43,053 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59825ms for 60000ms of delay, sleeping for 185ms
02.12.2021 17:25:43,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:43,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 182
02.12.2021 17:25:43,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,087 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:43,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:43,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:43,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:43,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 81
02.12.2021 17:25:43,181 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,181 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:43,181 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1071) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:43,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:43,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:43,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:43,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:43,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:43,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:43,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:43,239 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142971, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:43,239 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142981, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:43,239 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1071): org.apache.kafka.common.requests.HeartbeatResponse@72dff5a0
02.12.2021 17:25:43,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:43,240 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:43,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,240 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:43,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:43,240 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59305ms for 60000ms of delay, sleeping for 705ms
02.12.2021 17:25:43,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,241 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:43,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,249 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,281 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:43,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:43,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:43,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:43,341 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:43,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:43,379 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119921ms for 120000ms of delay, sleeping for 89ms
02.12.2021 17:25:43,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:43,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:43,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,432 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,442 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:43,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:43,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,446 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 332
02.12.2021 17:25:43,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:43,470 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119256ms for 120000ms of delay, sleeping for 754ms
02.12.2021 17:25:43,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,489 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:43,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:43,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:43,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 232
02.12.2021 17:25:43,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:43,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,588 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:43,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 185
02.12.2021 17:25:43,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:43,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:43,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 131
02.12.2021 17:25:43,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:43,689 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 84
02.12.2021 17:25:43,690 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:43,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:43,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,742 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:43,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,753 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 25
02.12.2021 17:25:43,773 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,774 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,774 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=745) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null}
02.12.2021 17:25:43,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 314
02.12.2021 17:25:43,778 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=745): org.apache.kafka.common.requests.HeartbeatResponse@5d242fb5
02.12.2021 17:25:43,778 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:43,778 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347
02.12.2021 17:25:43,778 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:43,778 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:43,778 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 41, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,778 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=746) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:43,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 309
02.12.2021 17:25:43,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,785 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,785 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,785 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=696) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null}
02.12.2021 17:25:43,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 160
02.12.2021 17:25:43,786 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=696): org.apache.kafka.common.requests.HeartbeatResponse@661c7db3
02.12.2021 17:25:43,786 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:43,786 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a
02.12.2021 17:25:43,786 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:43,787 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:43,787 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 42, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,787 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=697) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:43,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 159
02.12.2021 17:25:43,794 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:43,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:43,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:43,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:43,874 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:43,886 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:43,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:43,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,934 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,935 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:43,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,947 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,949 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59686ms for 60000ms of delay, sleeping for 324ms
02.12.2021 17:25:43,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:43,963 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239736ms delay out of 240000ms. Remaining 264ms. Executor queue at 0
02.12.2021 17:25:43,976 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239550ms for 240000ms of delay, sleeping for 460ms
02.12.2021 17:25:43,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:43,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,995 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:44,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:44,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:44,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,089 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:44,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 395
02.12.2021 17:25:44,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:44,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:44,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:44,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 295
02.12.2021 17:25:44,235 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119205ms for 120000ms of delay, sleeping for 805ms
02.12.2021 17:25:44,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:44,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,243 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 251
02.12.2021 17:25:44,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,254 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 341
02.12.2021 17:25:44,276 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58310ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:44,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 190
02.12.2021 17:25:44,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:44,343 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,343 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:44,345 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1408) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null}
02.12.2021 17:25:44,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 146
02.12.2021 17:25:44,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 241
02.12.2021 17:25:44,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:44,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:44,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,436 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 161
02.12.2021 17:25:44,437 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239326ms for 240000ms of delay, sleeping for 684ms
02.12.2021 17:25:44,445 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1408): org.apache.kafka.common.requests.HeartbeatResponse@4135718a
02.12.2021 17:25:44,445 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:44,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,450 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 45
02.12.2021 17:25:44,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 134
02.12.2021 17:25:44,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,497 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 2
02.12.2021 17:25:44,499 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,499 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=703) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null}
02.12.2021 17:25:44,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 249
02.12.2021 17:25:44,500 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=703): org.apache.kafka.common.requests.HeartbeatResponse@3c1216a7
02.12.2021 17:25:44,500 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,500 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,500 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,500 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=703) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null}
02.12.2021 17:25:44,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,500 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 191 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:44,500 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,500 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,500 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 91, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,501 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=704) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:44,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 247
02.12.2021 17:25:44,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 497
02.12.2021 17:25:44,501 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=703): org.apache.kafka.common.requests.HeartbeatResponse@22478141
02.12.2021 17:25:44,501 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,501 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 191 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:44,501 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,501 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,501 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 91, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,501 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=704) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:44,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 495
02.12.2021 17:25:44,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 60
02.12.2021 17:25:44,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 33
02.12.2021 17:25:44,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,590 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:44,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,595 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,595 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:44,595 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=709) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:44,596 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 159
02.12.2021 17:25:44,596 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=709): org.apache.kafka.common.requests.HeartbeatResponse@2cf929a0
02.12.2021 17:25:44,597 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:44,597 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,597 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:44,597 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=685) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:44,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 157
02.12.2021 17:25:44,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 339
02.12.2021 17:25:44,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 157
02.12.2021 17:25:44,600 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:44,599 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=685): org.apache.kafka.common.requests.HeartbeatResponse@6d8d99b7
02.12.2021 17:25:44,600 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:44,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 336
02.12.2021 17:25:44,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 336
02.12.2021 17:25:44,600 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:44,698 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 56
02.12.2021 17:25:44,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 236
02.12.2021 17:25:44,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,749 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,755 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 135
02.12.2021 17:25:44,857 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:44,903 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 33
02.12.2021 17:25:44,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,937 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,953 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:44,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,997 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 213066ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 213067ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1131): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:45,043 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,043 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999270, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:45,043 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999280, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1132) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:45,044 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:45,045 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119050ms for 120000ms of delay, sleeping for 960ms
02.12.2021 17:25:45,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:45,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,091 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:45,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,122 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239975ms for 240000ms of delay, sleeping for 35ms
02.12.2021 17:25:45,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:45,144 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1132): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:45,144 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=191, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:45,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:45,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 75 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 226004ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 76 iterations.
02.12.2021 17:25:45,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 76 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 226004ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:45,160 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4
02.12.2021 17:25:45,160 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:45,160 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry3-0], userDataSize=48)
02.12.2021 17:25:45,160 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:45,161 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:330] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Skip resuming since state is RUNNING
02.12.2021 17:25:45,161 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:45,161 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:45,161 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from RUNNING to REBALANCING
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions [redacted.Cloud.Message.Callback.Retry3-0]
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4
02.12.2021 17:25:45,161 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -113, 102, -95, 88, 18, 121, 70, 127, -96, 46, -1, -98, -97, 56, 99, 43, 0, 0, 0, 0, 0, 0, 0, 0, 41, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1409) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:45,161 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-0 because it is paused
02.12.2021 17:25:45,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:45,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:45,249 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:45,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,250 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,256 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,277 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59311ms delay out of 60000ms. Remaining 689ms. Executor queue at 0
02.12.2021 17:25:45,278 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59350ms for 60000ms of delay, sleeping for 660ms
02.12.2021 17:25:45,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:45,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:45,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,438 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:45,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,455 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,458 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:45,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,500 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:45,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,592 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:45,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:45,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:45,661 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-0 because it is paused
02.12.2021 17:25:45,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:45,661 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:45,661 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:45,661 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions [redacted.Cloud.Message.Callback.Retry3-0]
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:45,662 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:45,662 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from REBALANCING to RUNNING
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 76 iterations.
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 76 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 226506ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:45,664 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962818, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:45,664 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962828, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:45,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:45,669 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:45,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,669 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:45,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 76 iterations.
02.12.2021 17:25:45,678 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239406ms for 240000ms of delay, sleeping for 604ms
02.12.2021 17:25:45,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:45,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,751 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,762 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:45,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:45,920 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=697): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', members=[])
02.12.2021 17:25:45,920 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', members=[])
02.12.2021 17:25:45,920 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,920 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}
02.12.2021 17:25:45,920 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,920 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=698) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 35
02.12.2021 17:25:45,921 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=746): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', members=[])
02.12.2021 17:25:45,921 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', members=[])
02.12.2021 17:25:45,921 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,921 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}
02.12.2021 17:25:45,925 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,926 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=747) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 166
02.12.2021 17:25:45,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:45,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,943 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,943 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59332ms for 60000ms of delay, sleeping for 678ms
02.12.2021 17:25:45,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30258ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,968 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:46,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,003 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,007 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119813ms for 120000ms of delay, sleeping for 197ms
02.12.2021 17:25:46,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,078 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:46,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:46,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:46,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:46,187 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:46,187 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:46,188 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1072) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:46,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 73
02.12.2021 17:25:46,212 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119094ms for 120000ms of delay, sleeping for 916ms
02.12.2021 17:25:46,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:46,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,251 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:46,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:46,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,266 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30120ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,284 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239405ms for 240000ms of delay, sleeping for 605ms
02.12.2021 17:25:46,288 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1072): org.apache.kafka.common.requests.HeartbeatResponse@390f855f
02.12.2021 17:25:46,288 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:46,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:46,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:46,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,469 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:46,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,507 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:46,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,601 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:46,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,631 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59871ms for 60000ms of delay, sleeping for 139ms
02.12.2021 17:25:46,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:46,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:46,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:46,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,756 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,757 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,768 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,771 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59927ms for 60000ms of delay, sleeping for 83ms
02.12.2021 17:25:46,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:46,869 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58816ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:46,869 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,892 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239746ms for 240000ms of delay, sleeping for 264ms
02.12.2021 17:25:46,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:46,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,960 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,960 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:46,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,970 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,008 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:47,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:47,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,102 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:47,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,129 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119984ms for 120000ms of delay, sleeping for 26ms
02.12.2021 17:25:47,157 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119968ms for 120000ms of delay, sleeping for 42ms
02.12.2021 17:25:47,159 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239174ms for 240000ms of delay, sleeping for 836ms
02.12.2021 17:25:47,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:47,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:47,202 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119349ms for 120000ms of delay, sleeping for 661ms
02.12.2021 17:25:47,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,257 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:47,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,268 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 326
02.12.2021 17:25:47,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 226
02.12.2021 17:25:47,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,460 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 136
02.12.2021 17:25:47,469 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 126
02.12.2021 17:25:47,469 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=698): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,469 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a', protocol='stream'}
02.12.2021 17:25:47,470 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:47,470 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,470 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,470 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from RUNNING to REBALANCING
02.12.2021 17:25:47,470 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:47,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 1
02.12.2021 17:25:47,469 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=747): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,470 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347', protocol='stream'}
02.12.2021 17:25:47,470 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347
02.12.2021 17:25:47,470 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,471 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:47,471 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,471 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,471 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,471 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:47,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 132
02.12.2021 17:25:47,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,471 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:47,471 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,472 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,510 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,561 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 36
02.12.2021 17:25:47,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 26
02.12.2021 17:25:47,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 31
02.12.2021 17:25:47,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:47,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,603 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,603 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from REBALANCING to RUNNING
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:47,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,607 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,607 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:47,607 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=686) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:47,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 354
02.12.2021 17:25:47,607 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=686): org.apache.kafka.common.requests.HeartbeatResponse@245058d6
02.12.2021 17:25:47,607 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:47,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 354
02.12.2021 17:25:47,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 354
02.12.2021 17:25:47,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,606 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,608 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:47,608 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=710) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:47,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 161
02.12.2021 17:25:47,608 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=710): org.apache.kafka.common.requests.HeartbeatResponse@689ad6b1
02.12.2021 17:25:47,608 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:47,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 161
02.12.2021 17:25:47,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 161
02.12.2021 17:25:47,673 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:47,704 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:47,708 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 253
02.12.2021 17:25:47,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 60
02.12.2021 17:25:47,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,758 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:47,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,770 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:47,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:47,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 150
02.12.2021 17:25:47,869 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119781ms for 120000ms of delay, sleeping for 229ms
02.12.2021 17:25:47,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:47,869 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59816ms delay out of 60000ms. Remaining 184ms. Executor queue at 0
02.12.2021 17:25:47,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:47,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:47,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:47,889 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142981, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:47,895 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1142991, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:47,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 7 ms and fetched 10 records
02.12.2021 17:25:47,896 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:47,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,896 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:47,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:47,896 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59786ms for 60000ms of delay, sleeping for 224ms
02.12.2021 17:25:47,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:47,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 49
02.12.2021 17:25:47,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:47,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,967 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,974 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 282
02.12.2021 17:25:48,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:48,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:48,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,024 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:48,035 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239612ms for 240000ms of delay, sleeping for 398ms
02.12.2021 17:25:48,052 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,055 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:48,055 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1133) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null}
02.12.2021 17:25:48,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:48,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:48,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 182
02.12.2021 17:25:48,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 216125ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:48,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:48,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:48,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 216125ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:48,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:48,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,102 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1133): org.apache.kafka.common.requests.HeartbeatResponse@29fe9a35
02.12.2021 17:25:48,102 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:48,102 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:48,102 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:48,102 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:48,103 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 91, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 4])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:48,103 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1134) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:48,103 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999280, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:48,103 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999290, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:48,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:48,107 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:48,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,107 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:48,112 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119388ms for 120000ms of delay, sleeping for 622ms
02.12.2021 17:25:48,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:48,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,118 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:48,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:48,132 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58015ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:48,161 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:48,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 293
02.12.2021 17:25:48,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 288
02.12.2021 17:25:48,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:48,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:48,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,259 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,270 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:48,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:48,319 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:48,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:48,383 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:48,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:48,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:48,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 76 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 229288ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 77 iterations.
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 77 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 229288ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1409): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', members=[])
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', members=[])
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:48,444 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}
02.12.2021 17:25:48,444 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:48,445 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1410) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:48,445 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962828, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:48,447 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962838, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:48,448 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1410): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:48,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 4 ms and fetched 10 records
02.12.2021 17:25:48,449 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:48,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,449 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 77 iterations.
02.12.2021 17:25:48,450 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239498ms for 240000ms of delay, sleeping for 512ms
02.12.2021 17:25:48,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:48,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,475 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 444
02.12.2021 17:25:48,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:48,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:48,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,534 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,545 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:48,545 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4', protocol='stream'}
02.12.2021 17:25:48,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:48,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:48,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 344
02.12.2021 17:25:48,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,620 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:48,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 301
02.12.2021 17:25:48,673 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:48,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:48,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 243
02.12.2021 17:25:48,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:48,735 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119989ms for 120000ms of delay, sleeping for 21ms
02.12.2021 17:25:48,759 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118295ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:48,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,760 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,772 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:48,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 143
02.12.2021 17:25:48,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:48,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:48,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:48,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 42
02.12.2021 17:25:48,922 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,922 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,922 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=748) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null}
02.12.2021 17:25:48,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,923 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=748): org.apache.kafka.common.requests.HeartbeatResponse@733b6e31
02.12.2021 17:25:48,923 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:48,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:48,921 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,924 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,924 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=699) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null}
02.12.2021 17:25:48,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 52
02.12.2021 17:25:48,924 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=699): org.apache.kafka.common.requests.HeartbeatResponse@f615522
02.12.2021 17:25:48,924 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 52
02.12.2021 17:25:48,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 52
02.12.2021 17:25:48,967 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239719ms for 240000ms of delay, sleeping for 291ms
02.12.2021 17:25:48,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:48,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:48,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,976 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:48,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,977 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,977 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:49,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,035 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:49,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:49,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,120 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:49,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,137 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59020ms delay out of 60000ms. Remaining 980ms. Executor queue at 0
02.12.2021 17:25:49,138 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58464ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:49,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:49,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:49,180 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:49,199 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:49,199 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:49,199 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1073) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:49,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:49,260 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238953ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:49,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,261 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,273 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:49,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:49,299 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1073): org.apache.kafka.common.requests.HeartbeatResponse@239dc395
02.12.2021 17:25:49,299 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:49,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:49,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:49,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:49,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:49,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:49,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:49,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,480 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:49,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,538 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:49,579 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:49,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:49,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,621 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,621 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,621 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,621 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:49,621 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,621 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,621 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:49,679 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:49,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:49,722 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:49,759 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119295ms delay out of 120000ms. Remaining 705ms. Executor queue at 1
02.12.2021 17:25:49,765 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119044ms for 120000ms of delay, sleeping for 966ms
02.12.2021 17:25:49,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,766 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,775 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:49,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:49,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:49,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:49,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:49,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:49,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 188
02.12.2021 17:25:49,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:49,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,987 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:49,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,989 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 88
02.12.2021 17:25:50,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,043 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,043 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:50,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:50,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:50,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:50,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:50,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,139 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59465ms delay out of 60000ms. Remaining 535ms. Executor queue at 1
02.12.2021 17:25:50,140 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59081ms for 60000ms of delay, sleeping for 929ms
02.12.2021 17:25:50,180 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:50,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:50,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:50,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:50,260 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239953ms delay out of 240000ms. Remaining 47ms. Executor queue at 2
02.12.2021 17:25:50,262 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239169ms for 240000ms of delay, sleeping for 841ms
02.12.2021 17:25:50,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,267 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,276 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 329
02.12.2021 17:25:50,285 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=704): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:50,285 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:50,285 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:50,285 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:50,285 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:50,285 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=705) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,assignments=[]}
02.12.2021 17:25:50,285 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=704): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:50,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 258
02.12.2021 17:25:50,285 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:50,286 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:50,286 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=705) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,assignments=[]}
02.12.2021 17:25:50,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 480
02.12.2021 17:25:50,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:50,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:50,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:50,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 229
02.12.2021 17:25:50,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:50,389 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=705): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,389 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=705): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:50,397 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,399 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:50,397 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,400 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:50,400 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:50,403 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:50,403 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:50,403 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:50,411 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:50,411 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:50,411 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,411 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,413 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:50,413 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,413 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from RUNNING to REBALANCING
02.12.2021 17:25:50,413 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:50,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 146
02.12.2021 17:25:50,412 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:50,421 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,422 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:50,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 370
02.12.2021 17:25:50,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:50,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 126
02.12.2021 17:25:50,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,489 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 117
02.12.2021 17:25:50,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:50,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,495 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 30
02.12.2021 17:25:50,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 243
02.12.2021 17:25:50,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:50,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:50,544 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 22
02.12.2021 17:25:50,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 17
02.12.2021 17:25:50,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,608 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:50,608 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=711) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:50,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 170
02.12.2021 17:25:50,609 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=711): org.apache.kafka.common.requests.HeartbeatResponse@18684729
02.12.2021 17:25:50,609 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:50,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 168
02.12.2021 17:25:50,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 168
02.12.2021 17:25:50,612 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,613 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:50,613 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=687) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:50,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 377
02.12.2021 17:25:50,614 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=687): org.apache.kafka.common.requests.HeartbeatResponse@56b07e27
02.12.2021 17:25:50,614 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:50,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 376
02.12.2021 17:25:50,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 376
02.12.2021 17:25:50,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 143
02.12.2021 17:25:50,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,625 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:50,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:50,698 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:50,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 68
02.12.2021 17:25:50,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 276
02.12.2021 17:25:50,726 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:50,726 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 41
02.12.2021 17:25:50,733 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119565ms for 120000ms of delay, sleeping for 445ms
02.12.2021 17:25:50,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:50,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:50,768 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:50,768 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:50,768 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:50,768 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:50,768 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:50,768 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:50,768 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:50,768 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:50,768 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from REBALANCING to RUNNING
02.12.2021 17:25:50,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:50,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,768 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,769 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:50,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,778 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:50,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 176
02.12.2021 17:25:50,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:50,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:50,869 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:50,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:50,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:50,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 70
02.12.2021 17:25:50,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:50,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:50,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 293
02.12.2021 17:25:50,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:50,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,991 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:50,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,998 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:51,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:51,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,046 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,073 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59968ms for 60000ms of delay, sleeping for 42ms
02.12.2021 17:25:51,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 183
02.12.2021 17:25:51,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:51,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:51,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:51,106 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239926ms for 240000ms of delay, sleeping for 84ms
02.12.2021 17:25:51,118 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59760ms for 60000ms of delay, sleeping for 250ms
02.12.2021 17:25:51,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,126 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:51,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:51,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,183 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119909ms for 120000ms of delay, sleeping for 101ms
02.12.2021 17:25:51,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 82
02.12.2021 17:25:51,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:51,192 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239201ms for 240000ms of delay, sleeping for 809ms
02.12.2021 17:25:51,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:51,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:51,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:51,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:51,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,269 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:51,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,283 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,285 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119844ms for 120000ms of delay, sleeping for 166ms
02.12.2021 17:25:51,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:51,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:51,327 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:51,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:51,370 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59728ms for 60000ms of delay, sleeping for 282ms
02.12.2021 17:25:51,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:51,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:51,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:51,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 190
02.12.2021 17:25:51,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:51,452 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,452 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,453 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1411) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null}
02.12.2021 17:25:51,456 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119604ms for 120000ms of delay, sleeping for 406ms
02.12.2021 17:25:51,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:51,488 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,499 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 421
02.12.2021 17:25:51,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:51,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:51,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,548 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,555 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1411): org.apache.kafka.common.requests.HeartbeatResponse@19b1a17
02.12.2021 17:25:51,555 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:51,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:51,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 321
02.12.2021 17:25:51,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,626 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:51,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:51,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:51,654 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58693ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:51,673 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:51,690 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:51,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:51,704 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 217
02.12.2021 17:25:51,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:51,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:51,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,771 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:51,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,788 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,794 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:51,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 116
02.12.2021 17:25:51,828 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:51,850 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:51,873 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119989ms for 120000ms of delay, sleeping for 21ms
02.12.2021 17:25:51,872 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,889 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 219928ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 219928ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1134): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', members=[])
02.12.2021 17:25:51,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:51,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 15
02.12.2021 17:25:51,904 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:51,912 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:51,912 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:51,912 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999290, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:51,912 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999300, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:51,912 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1135) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,assignments=[]}
02.12.2021 17:25:51,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 12 ms and fetched 10 records
02.12.2021 17:25:51,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:51,923 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,924 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:51,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,935 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,935 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,924 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,936 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=700) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null}
02.12.2021 17:25:51,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 77
02.12.2021 17:25:51,936 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=700): org.apache.kafka.common.requests.HeartbeatResponse@3a4461c
02.12.2021 17:25:51,941 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,941 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 59
02.12.2021 17:25:51,941 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 59
02.12.2021 17:25:51,935 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=749) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null}
02.12.2021 17:25:51,931 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:51,948 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119499ms for 120000ms of delay, sleeping for 511ms
02.12.2021 17:25:51,942 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:51,948 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=749): org.apache.kafka.common.requests.HeartbeatResponse@fa6ea53
02.12.2021 17:25:51,948 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 179
02.12.2021 17:25:51,951 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 176
02.12.2021 17:25:51,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 83
02.12.2021 17:25:51,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:51,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:52,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,001 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:52,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,003 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,005 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239274ms for 240000ms of delay, sleeping for 736ms
02.12.2021 17:25:52,017 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1135): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:52,023 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=192, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', protocol='stream'}
02.12.2021 17:25:52,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,052 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 73
02.12.2021 17:25:52,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:52,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:52,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:52,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:52,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,130 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:52,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:52,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:52,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:52,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:52,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:52,211 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:52,212 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:52,212 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1074) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:52,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:52,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:52,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,272 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:52,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,290 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:52,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:52,312 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1074): org.apache.kafka.common.requests.HeartbeatResponse@2a88a05e
02.12.2021 17:25:52,313 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:52,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:52,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:52,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:52,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:52,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:52,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:52,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:52,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:52,461 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119368ms for 120000ms of delay, sleeping for 642ms
02.12.2021 17:25:52,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:52,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:52,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,553 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:52,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:52,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:52,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,631 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:52,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:52,655 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59694ms delay out of 60000ms. Remaining 306ms. Executor queue at 0
02.12.2021 17:25:52,656 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58752ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:52,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:52,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:52,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:52,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:52,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,748 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239047ms for 240000ms of delay, sleeping for 963ms
02.12.2021 17:25:52,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:52,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,773 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:52,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,792 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:52,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:52,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:52,859 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:52,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:52,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:52,903 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:52,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:52,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 189
02.12.2021 17:25:52,964 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:52,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:52,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:53,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,003 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,004 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,043 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:53,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,054 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 231
02.12.2021 17:25:53,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:53,094 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:53,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,105 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:53,105 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119997ms for 120000ms of delay, sleeping for 13ms
02.12.2021 17:25:53,120 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119952ms for 120000ms of delay, sleeping for 58ms
02.12.2021 17:25:53,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:53,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,133 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:53,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 131
02.12.2021 17:25:53,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:53,179 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119395ms for 120000ms of delay, sleeping for 615ms
02.12.2021 17:25:53,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:53,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:53,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 30
02.12.2021 17:25:53,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:53,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,279 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 6
02.12.2021 17:25:53,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,285 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,285 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,286 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=706) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null}
02.12.2021 17:25:53,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 269
02.12.2021 17:25:53,286 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=706): org.apache.kafka.common.requests.HeartbeatResponse@66569932
02.12.2021 17:25:53,286 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:53,286 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:53,286 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:53,286 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:53,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,289 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,289 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,289 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=706) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null}
02.12.2021 17:25:53,289 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 92, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 491
02.12.2021 17:25:53,289 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=707) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:53,289 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=706): org.apache.kafka.common.requests.HeartbeatResponse@51d3a1f5
02.12.2021 17:25:53,289 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:53,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 265
02.12.2021 17:25:53,289 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:53,289 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:53,289 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:53,289 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 92, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,290 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=707) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 490
02.12.2021 17:25:53,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,293 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 313
02.12.2021 17:25:53,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:53,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:53,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,386 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,389 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 213
02.12.2021 17:25:53,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:53,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:53,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:53,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 113
02.12.2021 17:25:53,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,504 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 107
02.12.2021 17:25:53,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:53,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,555 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 12
02.12.2021 17:25:53,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 7
02.12.2021 17:25:53,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:53,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,607 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,608 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,608 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=712) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:53,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:53,608 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=712): org.apache.kafka.common.requests.HeartbeatResponse@263e55cb
02.12.2021 17:25:53,608 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:53,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:53,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:53,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,613 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,613 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,613 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=688) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:53,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 392
02.12.2021 17:25:53,614 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=688): org.apache.kafka.common.requests.HeartbeatResponse@68e54b37
02.12.2021 17:25:53,614 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:53,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:53,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:53,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,634 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:53,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,656 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59752ms delay out of 60000ms. Remaining 248ms. Executor queue at 0
02.12.2021 17:25:53,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:53,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:53,657 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1142991, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:53,657 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1143001, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:53,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:53,657 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:53,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,657 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:53,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:53,658 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58957ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:53,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:53,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 77 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 234556ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:53,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:53,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 78 iterations.
02.12.2021 17:25:53,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 78 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 234556ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:53,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:53,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:53,712 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4
02.12.2021 17:25:53,712 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:53,712 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry3-0], userDataSize=48)
02.12.2021 17:25:53,712 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:53,712 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:330] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Skip resuming since state is RUNNING
02.12.2021 17:25:53,712 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:53,712 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:53,713 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from RUNNING to REBALANCING
02.12.2021 17:25:53,713 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions [redacted.Cloud.Message.Callback.Retry3-0]
02.12.2021 17:25:53,713 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-0 because it is paused
02.12.2021 17:25:53,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:53,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,781 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,795 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,800 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119686ms for 120000ms of delay, sleeping for 324ms
02.12.2021 17:25:53,807 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:53,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:53,813 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-0 because it is paused
02.12.2021 17:25:53,818 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-0 because it is paused
02.12.2021 17:25:53,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:53,835 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:53,920 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-0 because it is paused
02.12.2021 17:25:53,924 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-0 because it is paused
02.12.2021 17:25:53,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 292
02.12.2021 17:25:53,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:53,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:53,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:54,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:54,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:54,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,013 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:54,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,018 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:54,024 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-0 because it is paused
02.12.2021 17:25:54,024 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-0 because it is paused
02.12.2021 17:25:54,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 188
02.12.2021 17:25:54,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:54,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,056 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:54,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:54,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:54,125 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-0 because it is paused
02.12.2021 17:25:54,125 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-0 because it is paused
02.12.2021 17:25:54,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 87
02.12.2021 17:25:54,126 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119828ms for 120000ms of delay, sleeping for 182ms
02.12.2021 17:25:54,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,135 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:54,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:54,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:54,213 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-0 because it is paused
02.12.2021 17:25:54,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:54,213 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:54,213 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:54,213 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:54,213 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions [redacted.Cloud.Message.Callback.Retry3-0]
02.12.2021 17:25:54,213 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:54,213 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:54,213 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:54,213 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:54,213 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b] State transition from REBALANCING to RUNNING
02.12.2021 17:25:54,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:54,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,214 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:54,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 78 iterations.
02.12.2021 17:25:54,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 78 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:54,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committing all active tasks [0_0] and standby tasks [] since 235058ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:54,214 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Flushing record collector
02.12.2021 17:25:54,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Prepared RUNNING task for committing
02.12.2021 17:25:54,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:54,214 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry3-0=OffsetAndMetadata{offset=962838, leaderEpoch=null, metadata='AQAAAX1788el'}} to coordinator kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,214 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1412) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry3,partitions=[{partition_index=0,committed_offset=962838,committed_leader_epoch=-1,committed_metadata=AQAAAX1788el}]}]}
02.12.2021 17:25:54,219 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:54,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:54,236 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received OFFSET_COMMIT response from node 2147483643 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1412): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry3', partitions=[OffsetCommitResponsePartition(partitionIndex=0, errorCode=0)])])
02.12.2021 17:25:54,236 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Committed offset 962838 for partition redacted.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:54,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry3-0=962837}
02.12.2021 17:25:54,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:54,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Committed all active tasks [0_0] and standby tasks [] in 0ms
02.12.2021 17:25:54,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:54,236 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962838, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:54,236 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962848, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:54,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:54,237 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:54,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,237 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:54,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 78 iterations.
02.12.2021 17:25:54,238 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239427ms for 240000ms of delay, sleeping for 583ms
02.12.2021 17:25:54,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,281 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:54,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:54,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,298 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,299 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:54,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 222333ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:54,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:54,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 70 iterations.
02.12.2021 17:25:54,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 70 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:54,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 222333ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:54,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:54,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:54,310 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:54,310 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:54,310 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:54,310 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 38, 27, -104, 122, 50, 35, 73, 21, -87, -124, -42, 103, -63, 40, -123, -81, 0, 0, 0, 0, 0, 0, 0, 0, 92, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 4])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:54,310 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, correlationId=1136) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer-fbe407e7-3afd-461f-9cf4-ba856c356cd6,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:54,310 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999300, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:54,310 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999310, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:54,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:54,311 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:54,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,311 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:54,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 70 iterations.
02.12.2021 17:25:54,312 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119964ms for 120000ms of delay, sleeping for 46ms
02.12.2021 17:25:54,314 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:54,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:54,333 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:54,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:54,363 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119544ms for 120000ms of delay, sleeping for 466ms
02.12.2021 17:25:54,399 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:54,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:54,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:54,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:54,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,513 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,520 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 403
02.12.2021 17:25:54,537 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,537 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,537 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1413) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null}
02.12.2021 17:25:54,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:54,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,557 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:54,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:54,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 303
02.12.2021 17:25:54,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,635 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:54,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:54,637 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1413): org.apache.kafka.common.requests.HeartbeatResponse@785c33b1
02.12.2021 17:25:54,637 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,658 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59957ms delay out of 60000ms. Remaining 43ms. Executor queue at 0
02.12.2021 17:25:54,659 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59851ms for 60000ms of delay, sleeping for 159ms
02.12.2021 17:25:54,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:54,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:54,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:54,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:54,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,783 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,783 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,800 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,800 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:54,822 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59901ms for 60000ms of delay, sleeping for 109ms
02.12.2021 17:25:54,825 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239784ms for 240000ms of delay, sleeping for 226ms
02.12.2021 17:25:54,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:54,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:54,846 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119687ms for 120000ms of delay, sleeping for 323ms
02.12.2021 17:25:54,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:54,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,927 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,928 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,928 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=701) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null}
02.12.2021 17:25:54,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:54,929 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=701): org.apache.kafka.common.requests.HeartbeatResponse@3b0d1a11
02.12.2021 17:25:54,929 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:54,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:54,936 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59997ms for 60000ms of delay, sleeping for 13ms
02.12.2021 17:25:54,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,937 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,937 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,938 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=750) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null}
02.12.2021 17:25:54,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:54,938 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=750): org.apache.kafka.common.requests.HeartbeatResponse@6f73c44f
02.12.2021 17:25:54,938 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:54,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:54,951 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59103ms for 60000ms of delay, sleeping for 907ms
02.12.2021 17:25:55,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,014 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,021 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:55,052 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239843ms for 240000ms of delay, sleeping for 167ms
02.12.2021 17:25:55,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,058 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:55,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:55,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,136 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:55,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,174 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119130ms for 120000ms of delay, sleeping for 880ms
02.12.2021 17:25:55,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:55,219 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,221 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239865ms for 240000ms of delay, sleeping for 145ms
02.12.2021 17:25:55,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:55,229 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:55,229 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:55,229 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1075) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:55,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:55,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,300 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:55,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:55,329 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1075): org.apache.kafka.common.requests.HeartbeatResponse@44637ffc
02.12.2021 17:25:55,330 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:55,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:55,367 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239137ms for 240000ms of delay, sleeping for 873ms
02.12.2021 17:25:55,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:55,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:55,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:55,441 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:55,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:55,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,519 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:55,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,524 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:55,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,559 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:55,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:55,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:55,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:55,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,644 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:55,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:55,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,734 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 293
02.12.2021 17:25:55,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,789 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,802 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:55,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 187
02.12.2021 17:25:55,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:55,884 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59869ms for 60000ms of delay, sleeping for 141ms
02.12.2021 17:25:55,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:55,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:55,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:55,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 84
02.12.2021 17:25:56,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:56,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,020 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:56,037 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59258ms for 60000ms of delay, sleeping for 752ms
02.12.2021 17:25:56,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,037 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,038 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:56,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,061 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,078 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119482ms for 120000ms of delay, sleeping for 528ms
02.12.2021 17:25:56,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:56,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:56,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 391
02.12.2021 17:25:56,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:56,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,151 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:56,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 286
02.12.2021 17:25:56,243 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239354ms for 240000ms of delay, sleeping for 656ms
02.12.2021 17:25:56,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 288
02.12.2021 17:25:56,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:56,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,290 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,303 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,303 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 304
02.12.2021 17:25:56,341 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:56,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 187
02.12.2021 17:25:56,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:56,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 203
02.12.2021 17:25:56,441 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:56,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 87
02.12.2021 17:25:56,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:56,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 103
02.12.2021 17:25:56,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,526 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:56,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,540 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,561 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:56,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:56,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,598 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 2
02.12.2021 17:25:56,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,609 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119532ms for 120000ms of delay, sleeping for 478ms
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,610 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:56,610 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=713) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:56,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:56,610 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=713): org.apache.kafka.common.requests.HeartbeatResponse@43efcc85
02.12.2021 17:25:56,611 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:56,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:56,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:56,614 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,614 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:56,614 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=689) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:56,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 414
02.12.2021 17:25:56,616 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=689): org.apache.kafka.common.requests.HeartbeatResponse@69a427bd
02.12.2021 17:25:56,616 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:56,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 411
02.12.2021 17:25:56,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 411
02.12.2021 17:25:56,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:56,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,653 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:56,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:56,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 311
02.12.2021 17:25:56,741 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:56,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,792 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,792 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,793 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59872ms for 60000ms of delay, sleeping for 138ms
02.12.2021 17:25:56,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,804 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 210
02.12.2021 17:25:56,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:56,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,900 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239913ms for 240000ms of delay, sleeping for 97ms
02.12.2021 17:25:56,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:56,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 110
02.12.2021 17:25:56,934 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59843ms for 60000ms of delay, sleeping for 167ms
02.12.2021 17:25:56,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:56,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:57,005 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238968ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:57,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:57,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 8
02.12.2021 17:25:57,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,027 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,043 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:57,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 10 records with 70 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:57,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 225113ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:57,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:57,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:57,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processed 0 records with 71 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:57,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 225113ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:57,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:57,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:57,089 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=999310, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:57,090 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=999320, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-4
02.12.2021 17:25:57,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:57,090 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-4, new queue size is 10
02.12.2021 17:25:57,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,090 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:57,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:57,092 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119040ms for 120000ms of delay, sleeping for 970ms
02.12.2021 17:25:57,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 10 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:57,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Committing all active tasks [0_2] and standby tasks [] since 30801ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:57,102 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Flushing record collector
02.12.2021 17:25:57,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Prepared RUNNING task for committing
02.12.2021 17:25:57,103 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry1-2=OffsetAndMetadata{offset=1143001, leaderEpoch=null, metadata='AQAAAX179pQD'}} to coordinator kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:57,103 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1076) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition_index=2,committed_offset=1143001,committed_leader_epoch=-1,committed_metadata=AQAAAX179pQD}]}]}
02.12.2021 17:25:57,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:57,122 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received OFFSET_COMMIT response from node 2147483644 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1076): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry1', partitions=[OffsetCommitResponsePartition(partitionIndex=2, errorCode=0)])])
02.12.2021 17:25:57,122 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Committed offset 1143001 for partition redacted.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:57,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry1-2=1143000}
02.12.2021 17:25:57,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:57,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Committed all active tasks [0_2] and standby tasks [] in 0ms
02.12.2021 17:25:57,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 8 iterations.
02.12.2021 17:25:57,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processed 0 records with 8 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:57,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:57,123 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1143001, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:57,123 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1143011, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-2
02.12.2021 17:25:57,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:57,123 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] task [0_2] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-2, new queue size is 10
02.12.2021 17:25:57,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:57,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1] Processing tasks with 8 iterations.
02.12.2021 17:25:57,124 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59987ms for 60000ms of delay, sleeping for 23ms
02.12.2021 17:25:57,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:57,144 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:57,148 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59024ms for 60000ms of delay, sleeping for 986ms
02.12.2021 17:25:57,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,154 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:57,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,207 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:57,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:57,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:57,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:57,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,293 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,305 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:57,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:57,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:57,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:57,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:57,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:57,455 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:57,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:57,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,527 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:57,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,545 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 382
02.12.2021 17:25:57,546 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,546 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,546 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1414) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer-3f59373d-5dd8-4a5e-a879-3560c28615c4,group_instance_id=null}
02.12.2021 17:25:57,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:57,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,601 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:57,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:57,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 282
02.12.2021 17:25:57,646 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, correlationId=1414): org.apache.kafka.common.requests.HeartbeatResponse@730973ba
02.12.2021 17:25:57,647 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,654 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:57,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,655 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 282
02.12.2021 17:25:57,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:57,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:57,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 181
02.12.2021 17:25:57,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 182
02.12.2021 17:25:57,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,795 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:57,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,836 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:57,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 80
02.12.2021 17:25:57,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 77
02.12.2021 17:25:57,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,932 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,932 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:57,938 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,945 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,945 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=751) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer-2b5da015-c3ea-4fdf-aabc-d7873066a347,group_instance_id=null}
02.12.2021 17:25:57,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:57,948 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, correlationId=751): org.apache.kafka.common.requests.HeartbeatResponse@13560793
02.12.2021 17:25:57,948 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 207
02.12.2021 17:25:57,932 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=702) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer-b69830de-63f4-4cf6-8c6f-98ba24e81c7a,group_instance_id=null}
02.12.2021 17:25:57,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 207
02.12.2021 17:25:57,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 113
02.12.2021 17:25:57,951 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, correlationId=702): org.apache.kafka.common.requests.HeartbeatResponse@3ef90926
02.12.2021 17:25:57,960 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,960 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 85
02.12.2021 17:25:57,960 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 85
02.12.2021 17:25:58,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,028 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,046 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239790ms for 240000ms of delay, sleeping for 220ms
02.12.2021 17:25:58,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 288
02.12.2021 17:25:58,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 104
02.12.2021 17:25:58,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,064 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,073 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119920ms for 120000ms of delay, sleeping for 90ms
02.12.2021 17:25:58,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,104 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,136 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58972ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:58,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:58,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 4
02.12.2021 17:25:58,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,156 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:58,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,164 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119917ms for 120000ms of delay, sleeping for 93ms
02.12.2021 17:25:58,172 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:58,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:58,247 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:58,247 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:58,248 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1077) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer-c51d5e30-4897-41b8-b937-60aa6b12e560,group_instance_id=null}
02.12.2021 17:25:58,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:58,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:58,261 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119019ms for 120000ms of delay, sleeping for 991ms
02.12.2021 17:25:58,268 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238974ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:58,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:58,295 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,296 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:58,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,342 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,349 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, correlationId=1077): org.apache.kafka.common.requests.HeartbeatResponse@1032f52
02.12.2021 17:25:58,351 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:58,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:58,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:58,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:58,442 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:58,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:58,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,529 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:58,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:58,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:58,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,570 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,605 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:58,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,658 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:58,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:58,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:58,743 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:58,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:58,776 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:58,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,797 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,838 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:58,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,843 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:58,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:58,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:58,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:58,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:58,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:59,030 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,031 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:59,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:59,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,072 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,073 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:59,137 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59973ms delay out of 60000ms. Remaining 27ms. Executor queue at 0
02.12.2021 17:25:59,137 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59875ms for 60000ms of delay, sleeping for 135ms
02.12.2021 17:25:59,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,160 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:59,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:59,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:59,254 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119315ms for 120000ms of delay, sleeping for 695ms
02.12.2021 17:25:59,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,268 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239974ms delay out of 240000ms. Remaining 26ms. Executor queue at 0
02.12.2021 17:25:59,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 10 records with 78 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:59,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 79 iterations.
02.12.2021 17:25:59,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processed 0 records with 79 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:59,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:59,269 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=962848, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:59,269 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=962858, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-0
02.12.2021 17:25:59,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:59,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:59,270 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] task [0_0] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-0, new queue size is 10
02.12.2021 17:25:59,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,270 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:59,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-1] Processing tasks with 79 iterations.
02.12.2021 17:25:59,270 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239311ms for 240000ms of delay, sleeping for 699ms
02.12.2021 17:25:59,273 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59214ms for 60000ms of delay, sleeping for 796ms
02.12.2021 17:25:59,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:59,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,298 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:59,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:59,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:59,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,366 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 242
02.12.2021 17:25:59,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:59,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:59,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:59,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 142
02.12.2021 17:25:59,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=707): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=707): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', members=[])
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:59,510 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=193, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', members=[])
02.12.2021 17:25:59,510 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=193, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=193, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=708) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=193,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1,group_instance_id=null,assignments=[]}
02.12.2021 17:25:59,511 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=193, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=193, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=193, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:59,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 287
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=708) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=193,member_id=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328,group_instance_id=null,assignments=[]}
02.12.2021 17:25:59,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:59,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,531 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 82
02.12.2021 17:25:59,542 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, correlationId=708): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,542 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, correlationId=708): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,543 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,544 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=193, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328', protocol='stream'}
02.12.2021 17:25:59,543 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,544 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 193 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer-7dee4c04-66b3-4795-bd16-153354eb7328
02.12.2021 17:25:59,544 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=193, memberId='staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1', protocol='stream'}
02.12.2021 17:25:59,544 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:59,544 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:59,544 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 193 and memberId staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer-211363ff-105c-4646-aed1-391ec5af1ca1
02.12.2021 17:25:59,545 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:59,545 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:59,545 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:59,545 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:59,545 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:59,545 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from RUNNING to REBALANCING
02.12.2021 17:25:59,545 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:59,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 64
02.12.2021 17:25:59,548 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:59,548 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:59,548 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:59,549 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:59,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 255
02.12.2021 17:25:59,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:59,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 41
02.12.2021 17:25:59,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,574 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,609 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,609 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,609 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=714) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer-a1a53463-7c15-49b9-a3f1-524d1a822b23,group_instance_id=null}
02.12.2021 17:25:59,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 257
02.12.2021 17:25:59,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:59,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:59,609 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:59,610 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,609 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, correlationId=714): org.apache.kafka.common.requests.HeartbeatResponse@7dfeb517
02.12.2021 17:25:59,611 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:59,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 255
02.12.2021 17:25:59,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 255
02.12.2021 17:25:59,614 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,614 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,614 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=690) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer-a11f3d4f-b39f-4e40-852e-6789de4f5e6d,group_instance_id=null}
02.12.2021 17:25:59,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 418
02.12.2021 17:25:59,615 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, correlationId=690): org.apache.kafka.common.requests.HeartbeatResponse@4f9454b7
02.12.2021 17:25:59,615 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:59,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 417
02.12.2021 17:25:59,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 417
02.12.2021 17:25:59,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 149
02.12.2021 17:25:59,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processing tasks with 52 iterations.
02.12.2021 17:25:59,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Processed 0 records with 52 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,676 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:59,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:59,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 155
02.12.2021 17:25:59,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 317
02.12.2021 17:25:59,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 49
02.12.2021 17:25:59,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:59,799 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:59,799 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af] State transition from REBALANCING to RUNNING
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,800 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:59,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 217
02.12.2021 17:25:59,813 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 53
02.12.2021 17:25:59,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:59,870 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:59,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,878 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:59,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:59,901 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-261b987a-3223-4915-a984-d667c12885af-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:59,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 115
02.12.2021 17:25:59,953 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119168ms for 120000ms of delay, sleeping for 842ms
02.12.2021 17:25:59,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:59,971 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239990ms for 240000ms of delay, sleeping for 20ms
02.12.2021 17:25:59,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-8f66a158-1279-467f-a02e-ff9e9f38632b-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:59,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bc34e2de-add9-46ff-b0cc-7764d4e7e21d-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400